AntiGrounding, a visual action-selection framework built around a dual geometric--visual trajectory interface, is presented, where component ablations and evaluator sensitivity characterize trajectory assessment, proposal search, orientation control, and evaluator choice.
Wen-Bo Li, Yi-Teng Chen, Wen-Hao Li et al.· 0 citations
Coding agents have emerged as a promising paradigm for robot manipulation: a language model writes the robot controller as a program, and agents built in this way now operate robots without robot-specific training.Whether this paradigm is also safe, however, has not been asked. We evaluate coding agent under a safety c...
Bing-Xin Xu, Yu-Zhang Shang, Zhen-Han Dong et al.· 0 citations
This paper proposes an alternative approach in which computationally intensive VLM queries are made during train-time to learn a lightweight latent memory that can be efficiently queried at deployment time, and demonstrates that the workspace tokens are not only more lightweight, but also lead to better policy performa...
Nitish Dashora, Douglas Chen, Idan Shenfeld et al.· 0 citations
FAMOS, a feed-forward model that predicts movable-part segmentation and joint parameters from a sparse, unordered set of partial point clouds, is presented and a procedural data generator that synthesizes self-annotated assets during training is introduced to overcome the limited scale and diversity of existing dataset...
Kevin Qu, Tao Sun, Massimiliano Viola et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
GeoAAC is proposed, a geometry-based adaptive action chunking method for flow-based VLA policies that adjusts the action horizon according to the reliability of the current action prediction, with geometric variation across action prefixes remaining positively correlated with predictive uncertainty.
Xin Chen, Sen Chen, Yu-Juan Ding et al.· 1 citation
Large-scale vision-language-action (VLA) models provide powerful priors for robot manipulation, yet adapting them to a specific deployment remains challenging. Supervised fine-tuning (SFT) on task-specific demonstrations provides a step toward deployment, but faces two persistent limitations: static data provide limite...
Zimu Han, Yi-Ming Zeng, Ji-Yao Zhang et al.· 0 citations
Autonomous underwater vehicles (AUVs) operating beyond reliable communications must recover from failures without human intervention. We investigate an architecture in which conventional deterministic layered control autonomy manages normal operations, while an invokable large language model (LLM) serves as a diagnosti...
Khalid Halba, Kylie Cooper, J. Bellingham· 0 citations
Sampling-Guided Policy Search (SGPS), which couples recurring action-target refinement by sampling-based model-predictive control with first-order policy optimization with first-order policy optimization, and shows that refinement improves policy learning beyond initialization and tracking alone.
Yi-Lang Liu, Hao-Xiang You, Qian Wang et al.· 0 citations
An automated pipeline is presented that transforms safe driving scenes into safety-critical scenarios by combining computer vision, Large Language Models (LLMs), and Augmented Reality (AR) to support the testing and validation of autonomous driving systems.
Noura Fady, Farah Khaled, Catherine M. Elias· 0 citations
VLN on the Fly, an onboard stack that keeps grounding, planning, and control as separate, inspectable stages that reaches the target in 13 of 15 trials with 5.72 cm mean goal error and 39.3% average GPU utilization.
Marco S. Tayar, F. Tommaselli, Gianluca Capezutto et al.· 0 citations
Astronex-World 1.0 is presented, an open controllable video world-model foundation that provides a bidirectional model for full-context generation and a causal model with block-causal attention and cross-block KV caching for persistent generation, both built on the Wan2.2-TI2V-5B prior.
Experiments on a real robot platform demonstrate that MaskHarness-WAM substantially outperforms limited-horizon policies on sequential multi-object manipulation, showing its effectiveness in extending local manipulation skills to reliable long-horizon execution.
Zi-Tai Huang, Taiyi Su, Jian Zhu et al.· 0 citations
A new system identifies and corrects unreliable object descriptions stored in a robot’s memory, improving the robot’s ability to interact with its environment.
Robots are getting smarter, but how can their hardware match that growth? New Microsoft Research findings show that moving AI inference beyond the robot can improve task success, boost efficiency, and support more advanced physical AI workloads. The post Offloaded inference for real-world physical AI robotics appeared first on Microsoft Research.