Shi-Yun Xiong

Beyond Omni: A Unified MLLM for Embodied Sensory Understanding

Recent embodied systems increasingly build on multimodal large language models (MLLMs) for their pretrained understanding and reasoning capabilities, but their perception of the physical world remains largely limited to basic modalities such as vision and audio. However, broadening MLLMs to more diverse sensory modalit...