Depth-Grounded Vision Language Models: Conversational AI in Spatial Interfaces for Robot-Supported Mixed Reality
Large language models (LLMs) and vision-language models (VLMs) are increasingly used in mixed-reality (MR) interfaces, yet most operate on text or 2D imagery and remain unreliable for metric spatial reasoning. We present an exploratory robot-supported MR prototype that combines RGB-D sensing, YOLO object detection, and...