Skip to content

Matrix-Free Photoacoustic Image Reconstruction via Sensor-Token Self-Attention

Jul 2026 · arXiv.org · Vol abs/2607.25576 · 0 citations · 36 references
Computer Science

TL;DR

The Sensor Attention Network is proposed, a Transformer-based architecture that treats the full time series of each sensor as a token and maps raw measurements directly to the reconstructed image without invoking the system matrix at inference, supporting real-time PAT reconstruction.

Abstract

Photoacoustic tomography (PAT) combines the optical absorption contrast of biological tissue with the spatial resolution of ultrasound, yet recovering the initial pressure distribution from sparse-view sensor measurements remains an ill-posed inverse problem. Iterative compressive-sensing solvers and unrolled deep networks both retain a dependence on the system matrix at inference, which leaves real-time clinical reconstruction computationally expensive. This paper proposes the Sensor Attention Network (SAN), a Transformer-based architecture that treats the full time series of each sensor as a token and maps raw measurements directly to the reconstructed image without invoking the system matrix at inference. For training and benchmarking, an analytical k-space H-matrix is constructed and validated against the k-Wave pseudo-spectral solver under matched geometry, achieving a mean per-sensor Pearson correlation of 0.919 +/- 0.049, with k-space apodization and Gaussian temporal damping acting synergistically to reduce the energy-normalized mismatch by 49%. Trained with a vessel-weighted loss on 488 augmented samples and evaluated on 46 held-out samples against ISTA, split-Bregman total variation (SBTV), and learned ISTA (LISTA), SAN attains the highest mean SSIM (0.522) and PSNR (22.09 dB) and the lowest NMSE (0.233). Paired t-tests and Wilcoxon signed-rank tests confirm the superiority of SAN over LISTA on PSNR, NMSE, and Pearson correlation at p<1e-8, and over ISTA and SBTV on all fidelity metrics. By bypassing the H-matrix at inference, SAN reduces reconstruction time by at least an order of magnitude, supporting real-time PAT reconstruction.

View source

Similar papers

Open access Jan 2026

A Learning-based Framework for Spatial Impulse Response Compensation in 3D Photoacoustic Computed Tomography.

This study presents a framework for establishing a learned data-domain SIR compensation method that maps SIR-corrupted PACT measurement data to compensated data that would have been recorded by idealized point-like transducers, and demonstrates resolution improvement and robustness to noise variations, object complexit...

Kai-Yi Yang, Seonyeong Park, Gangwon Jeong et al. · 1 citation
Preprint Aug 2026

Simulation-Based Imaging: Learning Acoustic Inverse Problems from Simulated Data

We introduce Simulation-Based Imaging (SBI), a framework for non-destructive acoustic imaging in which machine learning models trained entirely on simulated data serve as real-time solvers for the acoustic inverse problem. A high-fidelity nodal Discontinuous Galerkin forward solver generates large training datasets by...

L. Bodmer, E. Pitman · 0 citations
Preprint Aug 2026

PAGS: Autofocusing Photoacoustic Tomography via Speed-of-Sound-Adaptive Gaussian Splatting

PAGS, a differentiable framework for blind autofocusing PACT via speed-of-sound-adaptive Gaussian splatting, is proposed, which demonstrates improved reconstruction sharpness under heterogeneous acoustic media, robustness to sparse-view sampling, and computational benefits from the analytic Gaussian projection.

Jia Ge, Jin-Tao Ma, Bangxu Fan et al. · 0 citations
Preprint Aug 2026

On the Fundamental Limits of Single-snapshot Compressive Ultrasound Imaging Using Random Aberrative Masks

Compressive sensing emerges as a paradigm shift to realize real-time volumetric ultrasound imaging using a single element transducer equipped with an aberrative mask. Such a coded aperture encodes each scatterer in the FoV as a specific echo signal, compressing each volumetric into a time sequence that are reconstructe...

Zehua Dou, Yaokuan Zhang, Jialong Zhang et al. · 0 citations
Jul 2026

3D Uncertainty Quantification for the Photo-Acoustic Tomography

Photoacoustic tomography (PAT) is a promising modality for high-resolution biomedical imaging, motivating the need for reliable uncertainty quantification (UQ) of reconstructed images. Bayesian approaches provide a rigorous framework for UQ but remain computationally challenging for realistic three-dimensional PAT and...

B. Afkham, A. Alghami, H. Yazdanian et al. · 0 citations
Dataset Open access Aug 2026

OpenQPAIData: Measurements of test objects with reference labels for quantitative photoacoustic imaging research

This work presents a dataset of 30 tissue-mimicking phantoms imaged using three different photoacoustic systems and believes that OpenQPAIData enables the benchmarking of both acoustic and optical inverse solvers and supports the development of image quality assessment metrics for photoacoustic imaging.

Janek Gröhl, S. K. Kalva, Berkan Lafci et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.