Improving joint audio-visual reasoning in Omni Large Language Models typically incurs substantial data construction and training costs. Our diagnostics reveal multi-hop reasoning difficulties despite correct answers to all corresponding single-hop questions and suggest partial decoupling in the local optimization of pe...
Zi-Yang Cheng, Yu-Hao Wang, Hong-Cheng Liu et al.· 0 citations
The proposed LaSR (Latent Speech Reasoning), a novel training paradigm featuring a context-aware reasoning trajectory that leverages the latent reasoning process, significantly improves terminology recognition without introducing additional latency and consistently outperforms standard supervised fine-tuning baselines.
S$^3$-Bench is introduced, a systematic evaluation framework covering 10 major disciplines, consisting of a Knowledge set for speech question-answering and a Dialogue set for multi-turn progressive interactions with simulated user agents that systematically characterize the common challenges and performance tradeoffs o...
He-Yang Liu, Jia-Yi Huang, Wen Xiao et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.