Skip to content

Moderate-to-substantial agreement of ChatGPT-5 for Kellgren–Lawrence grading on synthetic knee radiographs: a controlled cross-sectional observer agreement study

Jul 2026 · Rheumatology International · Vol 46 · 0 citations · 41 references
Medicine

TL;DR

ChatGPT-5 showed moderate-to-substantial agreement with expert consensus under standardized experimental conditions under curated synthetic dataset, however, the curated synthetic dataset, limited technical reproducibility of web-based inference, systematic grading tendencies, exploratory nature of the secondary-model analysis, and limited ecological validity preclude any inference of clinical readiness or real-world diagnostic performance without validation on real-world, multicenter, prevalence-based knee radiograph datasets.

View source

Similar papers

Jul 2026

Performance of multimodal large language models versus clinicians for radiographic knee osteoarthritis grading: A multiobserver study.

Although ChatGPT-5.0 outperformed ChatGPT-4o, both models remained inferior to clinicians in detailed KL grading, feature-level interpretation, and reproducibility and are not suitable for standalone radiographic KOA assessment.

A. Akdoğan, Efe Kemal Akdoğan, Mehmet Fatih Tumer et al. · 0 citations
Open access Jul 2026

Assessment of Large Language Models and Expert Clinicians in Grading Mandibular Third Molar Extraction Difficulty

The examined LLMs showed grading tendencies partly comparable to those of human clinicians, without evidence of systematic directional bias; however, agreement remained below interexpert levels and was sensitive to conversational context.

S. Yoon, Jeong-Hun Yoo, Taejun Kim et al. · 0 citations
Review Open access Aug 2026

Inter- and Intraobserver Reliability of Wrist Arthroscopy for TFCC Tears: An International Study.

Arthroscopy demonstrated only moderate reliability for the assessment of TFCC pathology in this study, even among experienced hand surgeons, which highlights limitations of current arthroscopic classification systems and underscores the need for improved education and classification optimization to enhance diagnostic r...

M. Räisänen, Francesco Smeraglia, M. Clementson et al. · 0 citations
Review Open access Aug 2026

SP 9.02 Robustness of Retrospective Surgical Complication Grading for Time-Series Data Capture: An Inter-Observer Agreement Analysis Using Clavien-Dindo Classification

It is demonstrated that a supervised dual junior rater approach yields substantial-to-excellent inter-observer agreement in non-structural clinical data coding, however, agreement is likely over-estimated when only the highest grade is recorded over an extended interval (e.g. 30 days).

Sam Pathmanathan, Shi Lam, Sarah Alsaad et al. · 0 citations
Aug 2026

Structured ACR Bone-RADS Versus Unstructured Assessment of Bone Tumors on Radiographs: A Multicenter, Multireader Study Across Experience Levels.

Bone-RADS provides stable risk stratification, improves diagnostic performance and interreader agreement in early-career readers, and shifts management recommendations toward greater referral or workup of potentially malignant lesions.

Chunlin Song, Tianzi Jiang, Tongyu Wang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.