More Than Seeing: Vision as Scalable Anchors in Native Multimodal Pre-Training
Native multimodal pre-training trains a single model from scratch on text and multimodal data, enabling it to understand both language and visual inputs. However, how visual signals shape scaling behavior and support capabilities beyond visual understanding remains unclear. We investigate this question through controll...
Haoyuan Wu, Ao-Qi Wu, Jia-Ni Hu et al.
· 0 citations