Conducting a Literature Search to Establish State of the Art in Clinical Evaluation

Introduction

For medical device manufacturers operating under the EU MDR, the literature search used to establish the state of the art is one of the most consequential and most frequently underestimated elements of the clinical evaluation. This is particularly true for devices that rely on existing clinical experience rather than extensive pre-market clinical investigations.

In notified body reviews, weaknesses in the literature search surface as questions about logic, comparability, and justification. The device may be clinically acceptable, but the evidentiary benchmark against which it is assessed is poorly defined. When that happens, the entire clinical evaluation becomes fragile.

A robust literature search is not about compiling a large volume of publications. It is about constructing a defensible, transparent and clinically meaningful representation of current medical practice against which safety, performance and clinical benefit can be assessed.

Why the State of the Art Matters in Practice

Under the MDR framework and established good practice reflected in MEDDEV 2.7/1 rev. 4, the state of the art is the clinical and technological benchmark that defines what outcomes are reasonably expected for devices with similar characteristics and intended purposes. In practice, this benchmark drives far more than the narrative of the clinical evaluation report. It influences:

  • How residual risks are assessed and contextualised.
  • How clinical benefit is framed and defended.
  • How post-market clinical follow-up is designed.

When the SOTA is weak, selective, or implicitly shaped around the manufacturer’s own device, notified bodies are left without confidence that comparisons are meaningful. This is often where reviews slow down, not because of safety concerns, but because the underlying logic cannot be robustly followed.

The Literature Search Is Not an Annex

A recurring issue in clinical evaluations is that the literature search is treated as a downstream activity and is something produced late in the process to support conclusions that have already been reached.

This approach almost always creates avoidable problems. A literature search that is constructed to justify a predetermined position inevitably becomes selective, even when this is not the intent. Studies are excluded on grounds that are difficult to defend externally, and the overall picture no longer reflects real-world clinical use. A credible literature search must instead precede key evaluative conclusions. It should define the landscape first, even where that landscape is complex, inconsistent or inconvenient.

The Search Protocol Is Where Rigour Begins

The Literature Search Protocol is often viewed as a procedural requirement but, when done right, it is the most intellectually demanding part of the literature search and the primary determinant of its credibility.

Defining a PICO that reflects real clinical practice rather than idealised indications or study designs requires careful judgement. Overly narrow definitions risk excluding relevant safety or performance data. Overly broad definitions dilute relevance and obscure meaningful conclusions. Notified bodies do not expect perfection, but they do expect to see that these choices were made deliberately and with clinical awareness.

Database selection deserves similar attention. Bibliographic databases such as PubMed or Europe PMC are essential, but they rarely capture the full spectrum of clinical experience. Safety signals, device failures and real-world complications often sit in vigilance databases such as MAUDE, MHRA, BfArM or DAEN. These sources are not always easy to appraise, but excluding them without rationale increasingly raises questions during conformity assessment.

Inclusion and exclusion criteria must also be defensible to an external reviewer. Criteria that appear reasonable internally can look arbitrary when challenged if they are not clearly justified and consistently applied.

Transparency Over Exhaustiveness

One of the most persistent misconceptions in medical device literature searches is that strength lies in quantity. In notified body reviews, the opposite is often true. What reviewers look for is transparency.

Screening decisions should be traceable long after the search has been conducted. If it is unclear why certain publications were excluded, or why one comparator was deemed relevant and another was not, confidence in the entire exercise diminishes quickly. This does not require excessive documentation but a clear audit trail that allows the logic of the search to be reconstructed months or years later.

Once the final literature set is defined, the analysis should focus on extracting data that genuinely informs safety, performance and clinical benefit. Reproducing abstracts in tabular form adds little value. What matters is how the evidence collectively defines expected outcomes and known limitations for devices in current clinical use.

A State of the Art Without Limitations Is Not Credible

Literature searches that report only positive outcomes are increasingly viewed with scepticism since clinical reality is rarely that clean, and notified bodies are well aware of this.

Identifying known complications, failure modes, adverse events and variability in outcomes does not weaken a clinical evaluation but strengthens it. It demonstrates that the manufacturer understands the environment into which the device is being placed and has assessed its performance against realistic expectations rather than optimistic assumptions.

From a regulatory perspective, acknowledging limitations also creates stronger alignment between the clinical evaluation, risk management documentation and post-market surveillance planning. These linkages are closely scrutinised under the MDR and are difficult to establish when the state of the art has been selectively constructed.

The Long-Term Impact of a Weak Literature Search

The implications of a poorly constructed literature search extend far beyond initial conformity assessment. A fragile state of the art complicates lifecycle updates, weakens post-market clinical follow-up strategies and creates recurring challenges when new evidence emerges.

By contrast, a disciplined and well-reasoned literature search anchors the clinical evaluation in the realities of current medical practice, evolving evidence and acknowledged uncertainty. This is precisely what regulators expect under the MDR: not certainty, but informed, transparent judgement applied consistently over the device lifecycle.

At Specculo, we see time and again that manufacturers who invest in getting the literature search right early experience smoother notified body interactions and more resilient clinical documentation. Not because the process is more complex, but because the benchmark against which the device is assessed can withstand scrutiny. See our full range of regulatory services.