Developing and evaluating measurement instruments for intensive and high-acuity care: A practical six-step guide aligned with international measurement standards.
TL;DR
A structured, standards-aligned development pathway can strengthen the trustworthiness of scores and the clinical utility of instruments used in high-acuity care, supporting well-evidenced decisions across research and practice.
Abstract
INTRODUCTION Clinical decisions in intensive care, emergency, and high-dependency settings depend on defensible measurement of patient outcomes, care processes, and staff and family experiences. Systematic reviews have found that most outcome instruments used in acute care and survivorship research lack adequate evidence for key measurement properties, limiting confidence in research synthesis and clinical translation.
Objectives
The aim of this study was to provide a practical, six-step guide for developing and evaluating health measurement instruments for intensive and high-acuity care, bridging international measurement standards with the realities of acute clinical workflows.
Methods
This methods article integrates three complementary frameworks: the COnsensus-based Standards for the selection of health Measurement INstruments initiative, United States Food and Drug Administration guidance for patient-reported outcome development, and International Society for Pharmacoeconomics and Outcomes Research recommendations. Although the Food and Drug Administration guidance was developed specifically for patient-reported outcomes, its principles for content validity and stakeholder engagement are applied here to all clinical outcome assessments, including clinician-reported, observer-reported, and performance-based instruments. The guide follows the full instrument lifecycle, from need and gap analysis through construct definition, stakeholder engagement, item generation, and content validation to psychometric evaluation of key measurement properties.
Results
The guide positions early conceptual work as a critical safeguard against subsequent measurement problems and provides implementation-focused decision rules for proxy reporting, respondent burden, and cognitive interviewing in high-acuity contexts. A traceability matrix approach supports systematic documentation of item provenance and development decisions. The guide addresses a widening gap between established instrument development practices and the procedural and documentation standards now applied in evidence synthesis and critical appraisal of measurement properties. Applied examples drawn from published critical care measurement studies illustrate key decision points, and supplementary materials include decision aids, worked templates, and common pitfalls with corrective actions.
Conclusions
A structured, standards-aligned development pathway can strengthen the trustworthiness of scores and the clinical utility of instruments used in high-acuity care, supporting well-evidenced decisions across research and practice.