The Mirage of LLM Guardrails: A Case Study in AI-Assisted Medical Note Manipulation
A reproducible manipulation pipeline is developed that takes publicly available seed medical note templates and uses commercial LLMs to produce customized manipulated notes by substituting patient names, provider identities, dates, and medical conditions across multiple model families, input formats, and prompt phrasin...