Design and Content Validation of a Physician Performance Appraisal Tool for Bahrain Using Delphi Consensus and Complimentary Mixed-Methods
TL;DR
Evaluation of the framework's effectiveness in routine practice was beyond the scope of this study, but its implementation should proceed through staged, low-stakes introduction supported by assessor training, calibration, and further validation, including reliability testing and evaluation in real-world appraisal settings before consideration for wider institutional or regulatory use.
Abstract
Physician performance appraisal (PPA) is an important component of clinical governance and has the potential to contribute to broader public health objectives by promoting professional accountability, quality of care, and system reliability. Its public health relevance lies in supporting fairness, consistency, and accountability in clinical practice—principles that underpin equity, trust, and legitimacy within healthcare systems. In Bahrain, appraisal practices have evolved across institutions with varying organisational approaches and levels of formalisation. While these efforts demonstrate a commitment to performance evaluation, they also reveal variability in structure and limited integration of evidence-informed design, highlighting the need for a coherent, context-specific appraisal framework aligned with Bahrain Vision 2030. This study addressed this need through the development and content validation of a PPA tool tailored to Bahrain's healthcare context using a sequential exploratory mixed-methods design, in which the five research objectives guided the tool's developmental trajectory across a literature review and four empirical phases. A preliminary appraisal tool developed from the literature review was refined through qualitative interviews with expert consultants exploring contextual, behavioural, and organisational influences on PPA (Phase 1), followed by a two-round Delphi process to establish consensus on the importance of the appraisal domains and subcomponents (Phase 2). The refined tool was then evaluated for feasibility by non-consultant physicians to assess clarity, usability, and interpretive variation (Phase 3), and benchmarked against existing Bahraini appraisal systems to identify structural inconsistencies and accountability boundaries that informed the final framework (Phase 4). The principal outcome of the study was the development and content validation of a physician performance appraisal framework comprising nine domains and 28 subcomponents, organised around the core dimensions of clinical competence, professional behaviour, and system engagement. The domains comprise clinical reasoning and execution, medical knowledge and clinical experience, professional responsibility, resilience and operational performance, general and service delivery skills, professionalism and ethical conduct, continuous professional development, communication and collaboration, and clinical effectiveness and system impact. Behaviourally Anchored Rating Scales (BARS) translate these competencies into observable performance indicators, improving conceptual clarity and promoting more consistent interpretation during appraisal. While aligned with international competency models, the framework is grounded in Bahrain's organisational and cultural context. It has the potential to support more consistent, development-oriented appraisal practices and strengthen alignment between clinical performance, governance priorities, and principles of fairness and accountability. However, evaluation of the framework's effectiveness in routine practice was beyond the scope of this study. Its implementation should therefore proceed through staged, low-stakes introduction supported by assessor training, calibration, and further validation, including reliability testing and evaluation in real-world appraisal settings before consideration for wider institutional or regulatory use.