Multimodal inputs are inherently heterogeneous, not only across modalities but also in the information pathways required for effective prediction. To address this limitation, we propose InstMoE, an adaptive expert routing framework for multimodal learning. InstMoE dynamically routes each input to specialized unimodal a...
Gui-Min Hu, Xiang He, Ying-Jian Li et al.· 0 citations
Experimental results show that incorporating user traits can aid personalized prediction, as this work aims to shift the research paradigm from developing agents suited for the average user to designing systems tailored to specific individuals.
Shu-Fan Zhang, Xin-Yi Che, Kuo-Fei Fang et al.· 0 citations
The results show that affective perception depends not only on the observed behavior, but also on how evidence is acquired, and by making observation acquisition experimentally controllable, AffectSim provides a foundation for studying embodied affective perception in interactive 3D environments.
Ke Xing, Zhi-Long Wang, Zheng Lian et al.· 0 citations
This work advances SPI research from static images to dynamic videos and ensures more comprehensive scenario coverage during benchmarking with RobotEQ-Video, a hierarchical world-state taxonomy organized into a four-level coarse-to-fine structure.
Xin-Yi Che, Zheng Lian, Kuo-Fei Fang et al.· 1 citation
This work introduces VideoGAIA, an agentic video understanding benchmark for general artificial intelligence (AI) assistants, and formulates video understanding as a multi-turn, tool-augmented interaction process, where models must iteratively perceive videos, invoke external tools, gather complementary information, an...
Fan Zhang, Guang-Ming Yao, Jin-Yang Wu et al.· 1 citation
This work aims to advance the development of socially desirable embodied agents in open-domain environments by extending the concept of proactive assistance to Social Proactive Intelligence (SPI), characterized by diverse scenarios, social understanding, and robot-centric behaviors.
Kuo-Fei Fang, Zheng Lian, Xin-Yi Che et al.· 3 citations
This paper introduces OneEmo, a unified affective generalist capable of mastering emotion perception, comprehension, and interaction, and proposes Emo-Chord, a novel reinforcement learning strategy that stabilizes optimization through unified multi-task reward allocation.
Jiahao Huang, Zheng Lian, Jingyi Zhang et al.· 0 citations
AC-VLA is introduced, a plug-and-play Action Compositional learning framework comprising two architecture-agnostic components that achieves a ~28% absolute improvement on compositional OOD tasks while maintaining near-perfect in-distribution performance.
Xiaojiang Peng, Kai Peng, Jie Lu et al.· arXiv.org· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.