A preliminary nonvalidated script for cone detection in retinal AO images with support from GPT-4 is developed and before such a script can be used in clinical research, it should undergo more fine-tuning and extensive testing.
Abstract
Background
The availability of dedicated image analysis scripts for adaptive optics (AO)-flood illumination ophthalmoscopy (FIO) is limited, especially for large-scale measurements and analyses of nonhealthy images. This limitation highlights the need for alternative approaches to facilitate automated and scalable analysis. Large language models may help develop such scripts.
Objective
This study aimed to generate an analysis script for AO-FIO images in the R programming language using a widely available generative AI (GenAI; specifically, GPT-4) as a proof of principle for generating a functional but nonvalidated script.
Methods
GPT-4 was used to generate an R script for the analysis of AO-FIO images. The code generated by GPT-4 was fine-tuned iteratively based on trial and error, testing the script for image preprocessing and analysis using images from 4 participants, including 1 healthy individual and 3 patients with Stargardt disease. The script code was subsequently checked for errors by another researcher who was naive to previous coding, using a different test set of AO-FIO images from 4 other participants (n=1 healthy individual and n=3 patients with Stargardt disease). The cone counts from 5 AO image snippets were compared with the counts independently recorded by 2 human graders and those generated by pre-existing AO analysis software that was trained on healthy participants.
Results
After 54 iterations of instructions, a functional R script for the analysis of AO-FIO images was generated. The script identified and quantified blobs.
Conclusions
We developed a preliminary nonvalidated script for cone detection in retinal AO images with support from GPT-4. Before such a script can be used in clinical research, it should undergo more fine-tuning and extensive testing. Future work should enhance the image analysis capabilities of the script and validate its results to assess the potential of AO-based cone counts as biomarkers in clinical trials.
Recent updates to HEEPS are presented, including modelling of the final METIS pupil and Lyot stops, revised quasi-static non-common path aberrations (NCPA) and Talbot effect simulations informed by as-built optical surface errors, and updated METIS Single Conjugated Adaptive Optics (SCAO) simulations.
Gilles Orban de Xivry, O. Absil, I. Hammond et al.· Astronomical Telescopes + In...· 1 citation
Two AI-based methods for accelerating wavefront inference are described: AIDonut, a neural-network replacement for the wavefront-estimation step, and TARTS, a larger framework that incorporates donut detection and sensor-level aggregation.
J. F. Crenshaw, H. Tohfa, P. X. Ma et al.· Astronomical Telescopes + In...· 0 citations
To address the challenges of low reproducibility due to operational variations in scientific research imaging and the complexity of analyzing a large number of samples using conventional methods, we introduce a protocol for staining HT22 cells with PI and Hoechst 33342 and then imaging and analyzing the data using the...
Xinyue Liu, Yili Wang, Zhen-Ting Tan· Journal of Visualized Experi...· 0 citations
Analyzer-based multiple-image radiography (MIR) is an X-ray phase-contrast imaging technique. It retrieves absorption, refraction, and ultra-small-angle X-ray scattering signals using the angular selectivity of a perfect-crystal analyzer. Conventional MIR processing typically relies on normalization between the object...
Farangis Foroughi, D. Krapohl, B. Norlin et al.· Journal of Synchrotron Radia...· 0 citations
Traditional quantitative differential phase-contrast (qDPC) imaging is constrained by the need for multiple intensity measurements, which limits its application for real-time living cell monitoring. This study introduces a single-shot quantitative DPC imaging method that integrates radially asymmetric color-encoded ill...
Ying-Ju Chen, Vu Quang Huy Tran, Sunil Vyas et al.· Optics and Photonics Interna...· 0 citations
Related blog posts
Microsoft Research Blog· microsoft.comNov 12, 2026
What's new in research at Microsoft? Host Anson Ho explores the latest, including AI-powered universal translation, a breakthrough in a 31-year-old mathematics challenge, and advances making AI coding agents faster and more efficient. The post Microsoft Research Focus – Edition #98 appeared first on Microsoft Research.
AI agents can generate code at a scale that’s hard for humans to review line-by-line. PDD Kit helps ensure the code is doing what the developer intended by creating formal specifications and testing against them. It converts developer intent into a Verus specification, proves AI-generated code meets it for every input, and uses tests where proofs aren't practical. Developers review intent, not every line. The post Formally verifying agent-written full-stack web apps with PDD Kit appeared first o…