Ming-Ke Lu

MIGU: Multimodal Instruction Grounding under Uncertainty for Manipulation Planning

Understanding natural human instructions is crucial for deploying robots in human-centric environments. We study multimodal instruction grounding, where language and gesture provide complementary but uncertain cues. We present MIGU, a modular framework that combines semantic and geometric evidence into a unified ground...