Apr 2026· BMJ digital health & AI· Vol 2, pp. e000085· 2 citations· 28 references
Medicine
TL;DR
This paper aims to highlight the challenges with identifying and assessing significant changes in the performance of a model and understanding the nature of a detected drift to preserve patient safety and outline the regulatory challenges associated with risk assessment and the characteristics of drift.
Abstract
Artificial intelligence (AI) as a Medical Device (AIaMD) or medical devices that use AI algorithms—like any other medical device—must meet the requirements of medical device regulation. For regulatory purposes, the most relevant requirement is that the developer must provide evidence that the device performs as intended under normal conditions of use for its entire lifecycle. However, healthcare data are not static and underlying characteristics can change for many reasons (eg, the introduction of new technologies which improve measurement accuracy, changes in population demographics, etc). This ‘drift’ may lead to a change in performance overall or in certain subgroups in AI models. Models can be updated with new data if significant drift is identified, but in the context of AIaMD, this needs to be done transparently and within a robust regulatory framework. This paper reports on the consensus view of an expert working group hosted by the UK Medicines and Healthcare products Regulatory Agency (MHRA). It aims to highlight the challenges with identifying and assessing significant changes in the performance of a model and understanding the nature of a detected drift to preserve patient safety. We discuss distinct drift subtypes from a statistical perspective and highlight potential causes in the real world that could lead to significant changes to the performance of AI algorithms. We also outline the regulatory challenges associated with risk assessment and the characteristics of drift that are crucial to examine (such as speed and severity) to correctly address interventions and ensure the deployment of safe healthcare products on the market. Finally, we discuss a range of considerations to best identify, risk-assess and intervene for drift when assessing healthcare AI products.
Abstract AI-based medical devices in the European Union are regulated under the Medical Device Regulation (MDR), which is built on structured conformity assessment processes and clearly defined product states [1]. However, the continuous and multidimensional evolution of AI systems, including updates, is inherently mis...
Kurosh Nazerian, Meinhard Schilling· Current Directions in Biomed...· 0 citations
Big data analytics plays a crucial role in providing usable insights for improving the strategic planning of the diagnosis methods in the healthcare industry, and here the big data helps the clinical professionals analyze the large numbers of datasets obtained from different demographic groups to identify which factor...
R. Balamurugan, A. Hameed, A. Bakhsh· Concurrency and Computation· 0 citations
AI systems are increasingly being introduced into healthcare, many of them meeting the threshold for regulation as medical devices. However, the regulatory frameworks built to evaluate their safety and performance were designed for stable, tangible products rather than the highly context-dependent, frequently updating...
Ellen Coughlan, Charlotte Radovanovic· EMJ Innovation· 0 citations
Artificial intelligence (AI) has several transformative effects on healthcare, like to facilitate clinicians in disease detection and to manage patient care with enhanced precision. Due to the increasing complexity of medical data and the growing volume of diagnostic images, the substantial computational power needed t...
Ghulam Mudassir, Hameed Ullah Khan, A. S. Al-Shamayleh et al.· 0 citations
Artificial intelligence (AI) platforms are becoming increasingly prevalent in healthcare. Unlike previous technologies, AI has the capability to perform tasks previously considered uniquely human including synthesizing historical information and data to establish a clinical diagnosis and constructing a treatment plan....
J. Haizlip, K. Hall, Natalie B. May· American Journal of Lifestyl...· 0 citations
Abstract The flexibility of generative artificial intelligence (AI), and specifically large language models (LLMs), holds promise to transform healthcare by offering new tools to improve patient care and enhance clinician efficiency. However, this flexibility introduces new challenges, as LLM applications might inadver...
J. Workum, Sade J. Krijgsman, I. Vajda et al.· BMJ digital health & AI· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.