This work proposes UMPIRE-Net (Unrolled Magnitude-Phase In REgularization Network), a PD-DL method that introduces separate learned regularizers for magnitude and phase components, together with a novel data-fidelity formulation that enforces measurements consistency.
Abstract
MRI reconstruction from undersampled k-space measurements is an ill-posed inverse problem. Physics-driven deep learning (PD-DL) methods have shown strong performance for this task by combining the MRI forward model with learned image regularization within algorithm-unrolling frameworks. However, most existing PD-DL methods reconstruct complex-valued images directly, thereby implicitly coupling magnitude and phase within a single learned representation. This coupled regularization may be suboptimal in reconstruction settings where accurate phase modeling plays an important role, such as partial Fourier (PF) imaging, where recovery of the omitted asymmetric k-space measurements depends on the underlying image phase. In such scenarios, explicit modeling of magnitude and phase as separate components may reduce the reliance on externally estimated or predefined phase information. To this end, we propose UMPIRE-Net (Unrolled Magnitude-Phase In REgularization Network), a PD-DL method that introduces separate learned regularizers for magnitude and phase components, together with a novel data-fidelity formulation that enforces measurements consistency. We evaluate UMPIRE-Net for accelerated MRI with PF across different datasets and acceleration factors. Experimental results demonstrate that our proposed method improves reconstruction quality compared with a conventional complex-valued PD-DL baseline, yielding sharper images and reduced artifacts. Code available at: https://github.com/MahdiSaberii/UMPIRE-Net
This work investigates the use of auxiliary k-space magnitude information for accelerated steady-state dynamic MRI reconstruction, and demonstrates strong consistency of k-space magnitudes across time-frames.
Mahdi Saberi, Y. Alçalar, Merve Gülle et al.· 0 citations
A model-driven bilevel optimization framework that couples SENSE-based image reconstruction with SPIRiT-based k-space calibration through shared CSMs, and introduces a deep-prior-guided regularization strategy that preserves the structure of classical linear regularizers while adaptively learning spatially varying regularization weights from denoised intermediate reconstructions.
Weipeng Chen, Yan-Ran Li, Raymond H. Chan et al.· Journal of Mathematical Imag...· 0 citations
This work designs an implicit pixel-wise learnable step size to adapt to the spatial gradient heterogeneity of CT images and develops a cross-prompt guiding mechanism to enable inter-domain prompt interaction, which facilitates efficient prompt generation and enhances the convergence stability of the model.
Wenchao Du, Qiao Mu, Huanhuan Cui et al.· IEEE Transactions on Medical...· 0 citations
Deep unfolding methods achieve state-of-the-art performance in coded aperture snapshot spectral imaging (CASSI) reconstruction but typically rely on closed-form data-fidelity updates that assume an ideal optical system. In practical CASSI systems, the field-dependent and wavelength-dependent point spread function (PSF) introduces convolutional coupling that breaks the diagonal structure of the normal equation, rendering closed-form updates inapplicable. We propose a deep unfolding framework that addresses this fundamental algorithmic challenge through three contributions: (1)~a $K$-step conjugate gradient (CG) unrolling that explicitly solves the non-diagonal normal equation under PSF-inclusive forward operators; (2)~a learned gradient refinement module with wavelength-adaptive step sizes generated from a per-wavelength PSF embedding; and (3)~a PSF-conditioned penalty estimator that adapts the ADMM regularization strength to the optical degradation severity. A Monte Carlo PSF training strategy further improves robustness to manufacturing-induced PSF variations. Our method achieves 30.53~dB on the KAIST dataset, +2.73~dB over the DPU baseline (1.27M) using a comparable number of parameters (1.42M), and +1.70~dB over a larger baseline (DPU-B+, 2.12M) using 33\% fewer parameters.
Xiang Li, Qiuyu Yue, Yang Zhang et al.· 0 citations
In scientific imaging, reconstructing an unknown image from noisy, incomplete measurements is often necessary for downstream tasks (e.g., classification, segmentation). We address this using a task-adapted framework that learns a data-driven regularizer tailored to the specific analysis task. We propose a bilevel learning approach: solving a lower-level variational optimization problem with a parameterized learnable regularizer, while optimizing its parameters by minimizing the upper-level task loss on training data. This facilitates learning a bespoke regularizer for a pre-trained task operator, or jointly learning the parameters of both the regularizer and a deep neural network-based task operator. We introduce a principled algorithm that accommodates inexact lower-level reconstructions (using an iterative first-order solver) and demonstrate its efficacy on challenging inverse problems (image deblurring, CT, and MRI) across classification and segmentation tasks. Our method achieves competitive end-task performance compared to existing methods that use deep networks for both reconstruction and task operators, but does so with a significantly parsimonious regularizer parameterization. Furthermore, our approach requires only raw measurements and task label pairs, eliminating the need for ground-truth reference images.
Aryan Saha, Subhadip Mukherjee· International Conference on...· 0 citations
Inverse problems in imaging are typically ill-posed and are solved using regularized optimization techniques or - in recent times, by employing deep neural networks. While the deep network method enables fast end-to-end reconstruction from raw measurements, it does not necessarily alter the fundamentally ill-posed nature of the underlying inverse problem. It is well known that diverse, non-redundant measurements can improve the robustness of reconstruction algorithms. However, acquiring multiple measurements typically - involves additional hardware and more complex system setups, that may not always be desirable for field deployment. In this work, we note that in both incoherent and coherent (phase retrieval) optical imaging, the irradiance patterns corresponding to two phase diverse measurements associated with the same test object have implicit local correlations, which may be learned by a suitable deep network. A physics informed data augmentation scheme is then described where a trained network is used for generating a phase diverse pseudo-data based on a ground truth data frame, typically acquired using a standard imaging system. We validate this data augmentation approach for both incoherent and coherent optical imaging - configurations, with vortex phase as a - diversity mechanism. Specifically, we observe that the generated pseudo-data closely match the corresponding ground-truth data, with comparable noise characteristics. We further demonstrate that the true data along with the augmented pseudo-data provide- high quality inverse solutions with simpler robust reconstruction algorithms. Our results may open new avenues for leaner, high-fidelity computational imaging systems across a broad range of applications.
J. Birdi, Tamal Majumder, Deb Proshad Halder et al.· Journal of Physics: Photonic...· 0 citations