E. Lastufka

DINOspec: Efficient Multimodal Alignment of Vision and Spectral Foundation Models for Astronomy

Astronomical observations provide multimodal views of physical systems, with images and spectra capturing complementary properties of celestial objects. Scientific foundation models can learn powerful representations from these observations, but representations learned by separate models remain difficult to combine. We...