Unified multimodal models (UMMs) can integrate understanding and generation within a single backbone. However, it is commonly known that these two capabilities can cause conflicting representations, leading to a central question: how representation and computation should be shared across functionalities? Existing UMMs...
Yin-Yi Luo, Hao-Yue Bai, Yi-Rou Ge et al.· 2 citations
Acoustic capture, device processing, and transmission coding in real calls jointly alter speech signals and may affect the reliability of audio deepfake detection. To systematically evaluate these effects, we introduce RealComm, a dataset pairing digital speech with recordings of the same utterances transmitted through...
Li Wang, Jin-Dong Wang, Wan Lin et al.· 0 citations
Unified multimodal models combine image understanding and generation within one system, creating an opportunity to improve both capabilities through paired image--text supervision. We examine the outputs of a pretrained unified model in both directions and observe a loss of specificity: generated images can contain the...
Hao-Yue Bai, Yin-Yi Luo, Yi-Cheng He et al.· 0 citations
UniSD integrates complementary mechanisms that address supervision reliability, representation alignment, and training stability, including multi-teacher agreement, EMA teacher stabilization, token-level contrastive learning, feature matching, and divergence clipping, and reveals when self-distillation improves over st...
Yiqiao Jin, Yi-Yang Wang, Lu-Cheng Fu et al.· arXiv.org· 7 citations· ⚡1
Pretrained unimodal models offer a flexible route to multimodal prediction through collaboration, but this collaboration can become less accurate than a surviving unimodal model when modalities are missing. We study this setting using fixed surviving-model anchors and find that collaborative gains can weaken or reverse...
Hao-Yue Bai, Yin-Yi Luo, He-Qing Huang et al.· 0 citations
Structured, iterative multi-agent AI co-creation can exceed single-AI and human-human ideation, suggesting role differentiation is advantageous when problems require both imaginative ideation and practical refinement.
Y. Luan, Luning Sun, YeunJoon Kim et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.