Realistic, fast robotics simulations could enable large-scale training of embodied AI models that transfer to the real world. However, despite decades of progress, available simulations cover only a narrow range of real-world tasks and physical phenomena. The core bottleneck is that creating better simulations requires...
BURGER is introduced, a language-conditioned robotic drawing benchmark with a scalable, prompt-driven pipeline for generating continuous drawing trajectories, both in simulation and the real world, revealing distinct failure patterns across VLA models.
Xiang-Yu Xu, Bang-Shuai Peng, Zi-Yi Liu et al.· 0 citations
Large language model (LLM) agents for personal health read wearable data and recommend, but do not learn about the individual in a way that can be audited or falsified. We present EpiCoach, an agentic system that treats one athlete, a cross-country mountain biker, as the subject of accountable N-of-1 science. Claims ab...
Autonomous highway driving for heavy-duty trucks is a challenging control problem. The greater mass, dimensions and intricate dynamics increase the requirements for cooperation from surrounding traffic in critical maneuvers, requiring a careful balance between safety constraints and efficient long-horizon decision maki...
Hooman Hamze, Benjamin Houshmand, Deepthi Pathare et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Robot foundation models increasingly rely on flow-based action generation for general-purpose manipulation, yet the generated actions are not guaranteed to satisfy physical constraints such as joint limits and collision avoidance. This problem is especially challenging when the feasible set cannot be described analytic...
Jianming Ma, Rongjun Jin, Yizhi Chen et al.· 0 citations
Universal Manipulation Interface (UMI) devices allow human experts to demonstrate tasks for robot learning without teleoperating physical robots. Using these demonstrations as training data still requires a consistent hardware setup, calibration, and data processing. We present UMI-Live, a full-stack open-source bimanu...
Govind Velamoor, Adrian Lin, Sam Jung et al.· 0 citations
Predicting future physical states stands as a central challenge in embodied intelligence. Existing video world models leave 3D dynamics implicit, action-based formulations remain tied to specific robot configurations, and 3D motion prediction models use flow-only supervision, providing a limited learning signal for phy...
Yu-Hao Lu, Jiong-Xu Chen, He-Xiang Wei et al.· 0 citations
Experience can help embodied agents turn high-level plans into grounded actions, but transferring it across tasks remains challenging: previously effective strategies may be inapplicable to the current state or fail to produce their intended outcomes. We present EmbodiExp, a framework for constructing transferable expe...
Zhifeng Gu, Ying Chen, Rui Jiang et al.· 0 citations
Tactus is presented, a textile-integrated sensing glove that co-optimizes three design pillars: a thin, conformal 3D-knit form factor, strategically placed capacitive tactile sensors at manipulation-relevant regions informed by empirical contact studies, and IMU-fused pose tracking that maintains accuracy through the h...
Li Guan, Rachael Granberry, Sahar A. Aseeri et al.· 0 citations
AtomTree is presented, a hierarchical framework for state-aware task planning with LLMs that incrementally builds a tree of subgoals and actions, where the LLM decides at each step, from the current symbolic state, whether to further decompose or to output a grounded low-level action.
Joint-embedding predictive architectures (JEPAs) learn to predict representations rather than pixels, offering a compact way to model how visual scenes evolve. We ask whether this predictive objective improves closed-loop control when a vision-language-action (VLA) policy already uses V-JEPA features. We call our JEPA-...
Rufeng Xiao (VLA Research Team, Synthoid.ai), Ruihao Xiao (VLA Research Team et al.· 0 citations
A new system identifies and corrects unreliable object descriptions stored in a robot’s memory, improving the robot’s ability to interact with its environment.
Robots are getting smarter, but how can their hardware match that growth? New Microsoft Research findings show that moving AI inference beyond the robot can improve task success, boost efficiency, and support more advanced physical AI workloads. The post Offloaded inference for real-world physical AI robotics appeared first on Microsoft Research.