AI-generated editorial illustration of a tuning fork and water-wave demonstration; no actual experiment or measurement is documented.
AI-generated editorial illustration. A conceptual tuning-fork and water-wave demonstration. Created for PSI Center. Image credit ↗

If a device causes no obvious problem during a study, does that mean it works? No: safety and effectiveness are different questions. Safety asks what harms or risks appear under specified conditions. Effectiveness asks whether the device produces the intended health benefit. A study can inform one question while leaving the other unresolved.

Safety concerns harm and risk

Safety assessment looks for harmful effects, malfunctions, or other risks associated with using a device. The answer is always bounded by the population studied, how long participants were observed, and how the device was used. A small study that reports no observed side effects can be useful, but it cannot rule out every uncommon or delayed problem.

Device oversight includes mechanisms for identifying problems after products enter use. FDA describes Medical Device Reporting as a way for the agency and manufacturers to identify and monitor incidents in which a device may have caused or contributed to death or serious injury, as well as certain malfunctions [2]. Monitoring is part of safety work because evidence continues to accumulate beyond an initial study.

Effectiveness concerns the intended benefit

Effectiveness asks whether a device does what it is meant to do for patients. A study needs to specify the claim and measure a suitable outcome. If a device is designed to monitor a signal, accuracy under relevant conditions matters. If it is intended to improve a health outcome, investigators must examine that outcome rather than rely only on a technical measurement.

Clinical trials test new medical approaches in people, and trial types are designed around different questions, including treatment, prevention, screening, or supportive care [1]. A promising result in one setting does not necessarily answer another. For instance, evidence that a device can detect a signal does not by itself show that using the signal improves health.

Early evidence has a narrow scope

Imagine a new sensor tested in a small group for a short period. Researchers might observe that it transmits readings and identify immediate skin irritation. That offers information about operation and some near-term safety. It does not necessarily reveal how well it performs across varied users, whether clinicians can act on its readings, or whether those actions improve outcomes.

The study design should fit the uncertainty. FDA’s Investigational Device Exemption allows investigational device use in clinical studies to collect safety and effectiveness data for a potential 510(k) or Premarket Approval submission [2]. Device study review requirements depend on risk: significant-risk studies require FDA and institutional review board approval, while nonsignificant-risk studies require institutional review board approval. These pathways support evidence gathering; they do not make an investigational result equivalent to demonstrated benefit.

Read conclusions at the right scale

The FDA’s device pathways also vary by class. Most Class II devices require a 510(k), which demonstrates substantial equivalence to a legally marketed device; most Class III devices require PMA, which includes clinical data supporting claims [2]. These are distinct regulatory routes. Their names should not be used as shorthand for universal proof of every possible outcome.

A careful report separates what investigators observed from what remains unanswered. “No side effects were reported” describes observations in a study; it does not mean risk is zero. “The device produced a signal” describes technical function; it does not prove clinical effectiveness. Reading those statements with their scope intact helps patients, clinicians, and researchers understand what the evidence actually supports.

FOLLOW THE EVIDENCE

Sources & further reading

  1. Clinical Trials: What Are the Phases? National Cancer Institute
  2. Medical Device Overview FDA

Prepared for the independent PSI Center reading library. About edition dates and source checking.

This explainer describes scientific principles. It does not assess individual treatment choices.