The results show that explicit particle dynamics are a promising low-dimensional interface for robot video prediction, while robust language grounding and appearance delivery remain the principal open challenges.
A central premise of latent world models is that predicting the future forces a representation to internalize the physics of its environment. Which physical quantities does a trained latent actually contain, and what decides this? We answer with controlled interventions in POKEWORLD, an interactive environment whose vi...
Kai-Zhen Tan, Xin Xu, Siru Tao et al.· arXiv.org· 2 citations
The overall results show that editable, consolidated memory can supply remembered context for robot planning, and full MEMORA--combining editing, typed stores, and consolidation--achieves the strongest aggregate results among the evaluated memory conditions.
CoToGrasp is a novel generative framework that synthesizes diverse, stable grasps strictly conditioned on specific contact topologies, and introduces a feature-based canonical workspace that projects local object features into a unified gripper-centric domain, effectively decoupling the semantic functional intent from...
Julien Mérand, Boris Meden, Li-Ming Chen et al.· 1 citation
Reach audiences
Advertise in front of researchers, engineers, and readers.
BATON improves task success by 11.6% and cumulative success by 14.9% over the SoTA and improves task success by 11.6% over the RoboMemArena on the long-horizon benchmark RoboMemArena.
Evidence Acquisition and Feasibility Gating (EAFG) is proposed, a framework that acquires visual evidence through VLM-generated exploratory subgoals and TAMP-based execution and applies a feasibility gate to decide whether to proceed with task planning, acquire further evidence, or halt.
Tsunehiko Tanaka, Matthew Stephenson, Alistair Macvicar et al.· 0 citations
Swarms of LLM-assisted autonomous robots are increasingly proposed for cooperative intelligence, surveillance, and reconnaissance (ISR) in contested environments. A growing class of their assurance failures arises not within any single platform but across the swarm: individually-compliant actions compose into a mission...
Nikolaos Kekatos, Stylianos Basagiannis, Panagiotis Katsaros et al.· 0 citations
Shielding has emerged as a promising approach for ensuring safety of AI-controlled autonomous systems. The algorithmic goal is to compute a shield, which is a runtime safety enforcement tool that needs to monitor and intervene the AI controller's actions if safety could be compromised otherwise. Traditional shields are...
Davide Corsi, Kaushik Mallik, Andoni Rodriguez et al.· 0 citations
Take three frontier mixture-of-experts models (Alibaba, OpenAI, NVIDIA; 3.6-4.0B active parameters each) and fine-tune them to reason in a low-resource language. On accuracy benchmarks almost nothing happens, and the benchmark itself is noise at this scale: changing only the random seed moves the score by 7.7 points, m...
A reinforcement learning-based framework for robotic grasp refinement, integrating keypoint-based object representations with a Deep Q-Network (DQN), is proposed, offering a scalable and adaptable solution for contact-rich manipulation tasks.
Amir Arsalan Nematollahi, Shayan Ahmadi, M. T. Masouleh et al.· 0 citations
This work employs encoder-decoder networks built around long-short term memory (LSTM) cells in a distributed optimization algorithm that allows unprecedented reconstruction accuracy or the usage of different prediction-horizon lengths without the necessity to retrain.
Torben Schiz, P. H. Nardelli, Henrik Ebel· 0 citations
Across four RoboTwin tasks spanning different horizons and coordination patterns, Prism-GRPO improves success and quality at matched rollout budgets and reaches target success rates with up to 56% fewer rollouts.
Zeyun Deng, Yuzhe Lu, Ya-Wei Wang et al.· 2 citations
A new system identifies and corrects unreliable object descriptions stored in a robot’s memory, improving the robot’s ability to interact with its environment.
Robots are getting smarter, but how can their hardware match that growth? New Microsoft Research findings show that moving AI inference beyond the robot can improve task success, boost efficiency, and support more advanced physical AI workloads. The post Offloaded inference for real-world physical AI robotics appeared first on Microsoft Research.