Skip to content
Preprint

Pic2Spec: Generative Modeling Reconstructs Single Cell Raman Fingerprints from Brightfield Images

Jul 2026 · 0 citations
Physics Mathematics

TL;DR

Pic2Spec is introduced, a framework that learns a shared latent biochemical representation linking image morphology to vibrational spectral structure, enabling virtual Raman spectroscopy without hardware, and is established as a first demonstration of chemically informative virtual molecular fingerprinting from brightfield images, complementing slow, hardware-intensive spectroscopy with computational inference.

Abstract

Single-cell molecular characterization remains a bottleneck in scalable biological analysis because of labeling requirements, limited multiplexing, and reagents that perturb physiology. Raman spectroscopy addresses these limits by providing chemically specific, label-free vibrational fingerprints, but long acquisition times and specialized instruments restrict high-throughput use. Here, we overcome this barrier by showing that spectral fingerprints can be reconstructed from brightfield microscopy using generative modeling. We introduce Pic2Spec, a framework that learns a shared latent biochemical representation linking image morphology to vibrational spectral structure, enabling virtual Raman spectroscopy without hardware. We validate Pic2Spec across mammalian and bacterial cells, generating high-fidelity spectra that reproduce measured Raman fingerprints with 98% cosine similarity and Pearson correlations of ~95%, while preserving biochemical peaks and population distributions. Beyond spectral similarity, Pic2Spec provides molecular-level resolution in bacterial systems: generated spectra discriminate mutation-driven transgenic states and predict GFP expression with accuracy approaching true Raman measurements, outperforming conventional image analysis by 20%. These findings establish Pic2Spec as a first demonstration of chemically informative virtual molecular fingerprinting from brightfield images, complementing slow, hardware-intensive spectroscopy with computational inference. By redefining microscopy as an inference-enabled molecular profiling platform, Pic2Spec democratizes label-free biochemical phenotyping and overcomes the hardware and time constraints that have confined spectroscopy to specialized laboratories. This enables high-throughput molecular analysis for clinical diagnostics, screening, and monitoring at the scale and accessibility of standard microscopy.

View source

Similar papers

#machine learning Preprint Aug 2026

RamanPFN: learning from Raman spectral structure with a tabular foundation model

RamanPFN is presented, a spectral representation framework that encodes dependencies before TabPFN inference and establishes explicit spectral representation as an effective interface between high-dimensional Raman measurements and reusable tabular inference.

Xing-Yu Pan, Huanfei Wang, Jin-Jiang Guo et al. · 1 citation
Jul 2026

Compressed Spectrotemporal Imaging for Multiplexed Protein and Transcript Detection in Single Cells.

Compression microscopy (CoM) is introduced, a spectrotemporal multiplexing strategy that leverages the distinct photobleaching kinetics of conventional fluorophores to provide an accessible and scalable route to high-dimensional single-cell fluorescence profiling.

Suyeon Shin, Hyo Geun Yun, Tae Won Kim et al. · 0 citations
Open access Aug 2026

Video-rate label-free molecular mapping in living plant tissue with a deployable optical encoder

Results show that compact passive spectral encoding, when optimized for biological inference rather than datacube recovery, enables deployable, label-free molecular videography of living plant tissue dynamics after task-specific calibration.

Alexander Ingold, Richard G. Baird, Dasmeet Kaur et al. · 0 citations
Open access Aug 2026

Genome-scale label-free imaging reveals cellular physiology encoded in bacterial collective architecture

The results show that bacterial multicellular development is an interpretable signature of genotype-phenotype relationships, which can be captured from simple brightfield timelapses, and µPULLI can be used to determine a drug target, characterize other pathogens, and classify bacterial species.

Seh Na S. Mellick, Jesse J. Derringer, Darin Boyes et al. · 0 citations
Sep 2026

Data-driven spectroscopic dictionaries and detector-calibrated inference for photon-limited Raman hyperspectral imaging of living cells

An unmixing framework in which the decoder of a physics-constrained autoencoder is restricted to a data-driven spectroscopic dictionary: band centers, widths, and pseudo-Voigt shapes are measured from the dataset and fixed, and the network learns only nonnegative band amplitudes, a smooth B-spline background, and a per...

Shunsuke Yagi, Norihide Sagami, Ikuto Eshima et al. · 0 citations
Open access Sep 2026

Revealing Hidden Raman Signatures Through Attention‐Based Spectral Unmixing

Raman spectroscopy is a widely used tool for nanoscale materials characterization, yet weak spectral features are often obscured by strong and spatially variable background signals. This challenge is particularly severe in interfacial and low‐dimensional systems, where dominant substrate responses make conventional ref...

Dmitriy A. Poteryayev, P. Novelli, Annalisa Coriolano et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.