Skip to content
#software testing Open access

Adaptive Optics Image Analysis Using Generative AI (GPT-4) Scripting: Exploratory Study.

Sep 2026 · JMIR Formative Research · Vol 10, pp. e94906 · 0 citations
Medicine

TL;DR

A preliminary nonvalidated script for cone detection in retinal AO images with support from GPT-4 is developed and before such a script can be used in clinical research, it should undergo more fine-tuning and extensive testing.

Abstract

Background

The availability of dedicated image analysis scripts for adaptive optics (AO)-flood illumination ophthalmoscopy (FIO) is limited, especially for large-scale measurements and analyses of nonhealthy images. This limitation highlights the need for alternative approaches to facilitate automated and scalable analysis. Large language models may help develop such scripts.

Objective

This study aimed to generate an analysis script for AO-FIO images in the R programming language using a widely available generative AI (GenAI; specifically, GPT-4) as a proof of principle for generating a functional but nonvalidated script.

Methods

GPT-4 was used to generate an R script for the analysis of AO-FIO images. The code generated by GPT-4 was fine-tuned iteratively based on trial and error, testing the script for image preprocessing and analysis using images from 4 participants, including 1 healthy individual and 3 patients with Stargardt disease. The script code was subsequently checked for errors by another researcher who was naive to previous coding, using a different test set of AO-FIO images from 4 other participants (n=1 healthy individual and n=3 patients with Stargardt disease). The cone counts from 5 AO image snippets were compared with the counts independently recorded by 2 human graders and those generated by pre-existing AO analysis software that was trained on healthy participants.

Results

After 54 iterations of instructions, a functional R script for the analysis of AO-FIO images was generated. The script identified and quantified blobs.

Conclusions

We developed a preliminary nonvalidated script for cone detection in retinal AO images with support from GPT-4. Before such a script can be used in clinical research, it should undergo more fine-tuning and extensive testing. Future work should enhance the image analysis capabilities of the script and validate its results to assess the potential of AO-based cone counts as biomarkers in clinical trials.

Read PDF

Similar papers

Open access Aug 2026

METIS high-contrast imaging simulations: from instrument modelling to science readiness

Recent updates to HEEPS are presented, including modelling of the final METIS pupil and Lyot stops, revised quasi-static non-common path aberrations (NCPA) and Talbot effect simulations informed by as-built optical surface errors, and updated METIS Single Conjugated Adaptive Optics (SCAO) simulations.

Gilles Orban de Xivry, O. Absil, I. Hammond et al. · 1 citation
Review Aug 2026

Deploying AI for active optics control of the Vera C. Rubin Observatory

Two AI-based methods for accelerating wavefront inference are described: AIDonut, a neural-network replacement for the wavefront-estimation step, and TARTS, a larger framework that incorporates donut detection and sensor-level aggregation.

J. F. Crenshaw, H. Tohfa, P. X. Ma et al. · 0 citations
Aug 2026

Standardized Workflow for High-Content Imaging and Data Processing.

To address the challenges of low reproducibility due to operational variations in scientific research imaging and the complexity of analyzing a large number of samples using conventional methods, we introduce a protocol for staining HT22 cells with PI and Hoechst 33342 and then imaging and analyzing the data using the...

Xinyue Liu, Yili Wang, Zhen-Ting Tan · 0 citations
Open access Nov 2026

MIR2-Toolkit: a Python program for multiple-image radiography analysis with integrated silicon-crystal diffraction modeling tools.

Analyzer-based multiple-image radiography (MIR) is an X-ray phase-contrast imaging technique. It retrieves absorption, refraction, and ultra-small-angle X-ray scattering signals using the angular selectivity of a perfect-crystal analyzer. Conventional MIR processing typically relies on normalization between the object...

Farangis Foroughi, D. Krapohl, B. Norlin et al. · 0 citations
Conference Oct 2026

Utilizing U-Nets for quantitative differential phase contrast imaging for biomedical images

Traditional quantitative differential phase-contrast (qDPC) imaging is constrained by the need for multiple intensity measurements, which limits its application for real-time living cell monitoring. This study introduces a single-shot quantitative DPC imaging method that integrates radially asymmetric color-encoded ill...

Ying-Ju Chen, Vu Quang Huy Tran, Sunil Vyas et al. · 0 citations

Related blog posts

Microsoft Research Blog Nov 12, 2026

Microsoft Research Focus – Edition #98

What's new in research at Microsoft? Host Anson Ho explores the latest, including AI-powered universal translation, a breakthrough in a 31-year-old mathematics challenge, and advances making AI coding agents faster and more efficient.  The post Microsoft Research Focus – Edition #98 appeared first on Microsoft Research.

Microsoft Research Blog Nov 5, 2026

Formally verifying agent-written full-stack web apps with PDD Kit

AI agents can generate code at a scale that’s hard for humans to review line-by-line. PDD Kit helps ensure the code is doing what the developer intended by creating formal specifications and testing against them. It converts developer intent into a Verus specification, proves AI-generated code meets it for every input, and uses tests where proofs aren't practical. Developers review intent, not every line. The post Formally verifying agent-written full-stack web apps with PDD Kit appeared first o…

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.