Skip to content

Automated readings of imaging reports by natural language processing (NLP) supplemented by clinical data predict disease course in children and adults with Crohn's disease: report from the epi-IIRN.

Jul 2026 · Scandinavian Journal of Gastroenterology · pp. 1-10 · 0 citations · 23 references
Medicine

TL;DR

An NLP tool to automatically extract imaging-based variables from radiological reports and integrate them with clinical data to predict disease course in children and adults with Crohn's disease (CD) enables scalable and standardized phenotyping of CD in large datasets and populations.

Abstract

INTRODUCTION The implementation of imaging features in administrative databases and electronic health records is limited by non-standardized free-text radiology reports. We developed a natural language processing (NLP) tool to automatically extract imaging-based variables from radiological reports and integrate them with clinical data to predict disease course in children and adults with Crohn's disease (CD).

Methods

Free-text reports from Magnetic-Resonance Enterography and Computed-Tomography Enterography of patients with newly diagnosed CD were linked to clinical data from the nationwide epi-IIRN cohort and processed using Hierarchical Structured Matching Prediction BERT (HSMP-BERT), an NLP model. The primary outcome was difficult-to-treat course, defined by steroid-dependency, the need for ≥2 classes of biologics or surgery. Predictors were identified using Cox proportional hazards and Gradient Boosting Survival Analysis (GBSA) machine learning models.

Results

Among 780 newly diagnosed patients, 160 (20%) developed difficult-to-treat course. Imaging-based predictors, including stricturing/penetrating disease, disease location, disease extent and the MaRIAs score, demonstrated modest discrimination for difficult-to-treat course (0.59 [95%CI 0.53-0.65]). Clinical predictors (laboratory values, induction treatment, age, sex and perianal involvement), showed better discrimination (AUC of 0.68 [95%CI 0.64-0.73]), while combining imaging and clinical variables resulted in only marginal improvement (AUC of 0.69 [95%CI 0.64-0.74]). In GBSA, the AUC was 0.57 (0.52-0.65) for radiologic model, 0.65 (0.62-0.72) to clinical model and 0.67 (0.61-0.72) to the integration model. For surgery, the improvement was more pronounced, in both, Cox regression and GBSA. Across models, the most influential predictors were induction treatment with systemic steroids, and stricturing or penetrating disease.

Conclusions

Automated NLP-based extraction of imaging reports linked to clinical and laboratory data enables scalable and standardized phenotyping of CD in large datasets and populations.

View source

Similar papers

Open access Aug 2026

Incremental Diagnostic Value of Clinical Information for Large Language Models Across Multiple Organs: Retrospective Study

The addition of clinical information was associated with a numeric trend toward higher diagnostic accuracy overall, but this trend was heterogeneous across models and disease types, and no statistically significant improvement was demonstrated after adjustment for multiple comparisons.

Jin-Qi Zhang, Xiao-Yi Wang, Yanfeng Zhao et al. · 0 citations
Open access Aug 2026

Using Natural Language Processing to Identify Adverse Drug Events Characterized by Medication Replacement in Primary Care Electronic Medical Records: Algorithm and Validation Study

Effective detection of ADEs in clinical notes may benefit from NLP models that approximate the clinical reasoning of health care providers as models evolve.

Alan Katz, Abhishek Dhankar, Gillian Fransoo et al. · 0 citations
Open access Sep 2026

Natural language processing for detecting endoscopy-related adverse events in free-text procedure reports at a tertiary referral centre in Türkiye: a 10-year retrospective diagnostic accuracy study

Abstract Objectives Automated surveillance of endoscopy-related adverse events (AEs) from non-English free-text reports remains insufficiently evaluated. We compared rule-based and transformer-based natural language processing (NLP) for classifying index procedure reports according to 30-day clinician-adjudicated AE st...

Y. Özden, Ömer Yüzügülen, N. Büyükberber · 0 citations
Open access Aug 2026

Harmonizing Multi-Institutional Clinical Documentation Using Natural Language Processing in Neurofibromatosis Type 1 (NF1)

Background and Objectives. Machine learning (ML) and natural language processing (NLP) approaches are increasingly used to support nuanced phenotyping, surveillance, and trial readiness using electronic health records (EHRs) in neurological disease. However, inconsistent clinical documentation limits data harmonization...

Stephanie M. Morris, Levi Kaster, S. Amagai et al. · 0 citations
#software testing Review Open access Aug 2026

Cutting chart-review time and improving database accuracy in inflammatory bowel disease with human-in-the-loop large language models

An open-source, human-verified workflow using large language models can accelerate electronic health record abstraction while improving accuracy and supports broader adoption of transparent artificial intelligence methods in clinical research.

Carl Jannes Neuse, Malte Janssen, S. Ibing et al. · 0 citations
Conference Open access 2026

Natural Language Processing for Prediction of Chronic Diseases from Electronic Health Records

This approach combines semantic understanding of clinical narratives with structural modeling of patient-disease-treatment relationships and successfully validates synthetic EHR data utility for privacy-preserving healthcare AI development while addressing critical requirements necessary for clinical decision support s...

U. Luke, P. Asuquo, Victor Anaga et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.