Mapping artificial intelligence integration in objective structured clinical examinations: A scoping review.
TL;DR
AI currently augments rather than transforms OSCE assessment, performing best in structured, observable tasks and least well in relational, situated, and culturally mediated competencies.
Abstract
INTRODUCTION Objective Structured Clinical Examinations (OSCEs) are widely used to assess clinical competence, but face challenges related to examiner workload, scoring variability, delayed feedback, and resource demands. Although AI may address these constraints and support precision medical education, the evidence remains fragmented. This scoping review maps AI applications in OSCEs.
Methods
We followed PRISMA-ScR. We searched MEDLINE, Scopus, Embase, Web of Science, ERIC, LILACS, and IEEE Xplore from inception to June 2025. Eligible studies examined AI within any phase of an OSCE in health professions education. Data charting captured AI form, technology, OSCE phase, competencies, outcomes, faculty and resource implications, and ethical/governance issues. Synthesis used a hybrid approach: deductive coding with FACETS, SAMR, and operationalized P4 properties, plus inductive coding for emergent themes. Findings were stratified by evidence maturity rather than formal quality scoring.
Results
Of 421 records screened, 22 studies were included. AI was used for learner preparation, station/material construction, scoring/evaluation, and operational delivery. Benefits were strongest for grading, feedback speed, and consistency in structured tasks, but weaker for relational competencies. Most applications reflected SAMR Augmentation or Modification. Personalization dominated P4 alignment. Ethical concerns centered on privacy, bias, accuracy, transparency, access, and human oversight.
Discussion
AND
Conclusion
AI currently augments rather than transforms OSCE assessment, performing best in structured, observable tasks and least well in relational, situated, and culturally mediated competencies. Claims that AI delivers precision medical education through OSCEs are not yet supported by evidence; alignment with P4 is partial and conditional. Realizing the potential of AI in OSCEs will require human-in-the-loop governance with concrete safeguards and equity-focused implementation in resource-limited settings.