This work proposes a practical framework for assessing privacy risk in clinical foundation models and illustrates realistic leakage scenarios across deployment settings, map them to legal regimes, and outline complementary technical and legal mitigations.
Abstract
Clinical foundation models trained on large-scale patient data are increasingly used for decision support, screening, and public health planning. As deployment expands, privacy risk arises from model-mediated leakage, yet its prevalence and severity remain poorly quantified. Models can disclose sensitive training artifacts, enabling patient re-identification in ways not captured by data-handling controls alone. As a result, existing frameworks, including HIPAA and GDPR, offer limited protection against assessing and addressing. We propose a practical framework for assessing privacy risk in clinical foundation models, illustrate realistic leakage scenarios across deployment settings, map them to legal regimes, and outline complementary technical and legal mitigations. Our analysis provides a context-aware risk assessment grounded in realistic usage to preserve the value of medical foundation models while rigorously safeguarding patient privacy.
Initial evaluations using various machine-learning algorithms on pre-and post-generalized datasets demonstrate the privacy framework’s effectiveness in mitigating privacy risks while preserving data usability.
Ze-Yang Zhu, Matthias N. Louws, Roland V. Bumbuc et al.· 0 citations
The analysis highlights how privacy-enhancing technologies offer benefits beyond anonymisation by embedding privacy-by-design values to support responsible innovation and protect sensitive patient data throughout the design, training, and validation of medical AI systems.
Yasmine Zoya· European Journal of Health L...· 0 citations
This paper empirically evaluates ChatGPT 3.5 and 4.0 using over 23,000 real user-generated medical queries, assessing their susceptibility to privacy breaches through quasi-identifiers such as age, location, phone number and national registration number and proposes a scalable privacy evaluation model that combines k-a...
Foad Jalali, Mehran Alidoost Nia· Journal of Supercomputing· 0 citations
Consumer digital health platforms have become an increasingly prominent feature of modern health care, collecting and storing sensitive health information directly from users. Yet most of these applications operate outside the scope of the Health Insurance Portability and Accountability Act (HIPAA), creating a signific...
Sandhya Srinivasa· SMU Science and Technology L...· 0 citations
This work will explore how PETs offer pathways through regulatory barriers, and how Trusted Research Environments (TREs), aligned with the Five Safes Framework, provide strong safeguards to prevent identifiable data disclosure, and demonstrate how remote querying techniques enable international analysis without data tr...
Edel McNamara, Cassie Smith, Neil Postlethwaite et al.· International Journal of Pop...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.