2AM shows that task memory can remain Agent-side and shows that Action Model capability depends not only on what the policy has learned, but on how precisely the Agent can steer it, and isolates this question through a deliberately constrained design.
Yu-Tong Hu, Feng Chen, Xue-Zhi Cao et al.· 2 citations· ⚡2
We propose a mathematical theory of pragmatic information that connects communication, control, and decision-making. Its central notion is the isoteleia mapping, which formalizes equifinality: distinct semantic paths that lead to the same optimal action are treated as pragmatically equivalent. This mapping yields a thr...
Reacting to sudden physical hazards is both a meaningful test of embodied intelligence and a hard requirement for deploying multimodal large language models (MLLMs) as the decision core of household robots, and ReactHuman is the first physics-grounded benchmark for human-like reactive decision-making.
Yi-Zhan Li, Jian-Xing You, Meng-Yang Xiong et al.· 0 citations
By decoupling haptic control loops from network bottlenecks, CARLAverse enables scalable, cross-institutional HITL experiments without compromising physical immersion.
P. Rebling, Philipp Nenninger, Reiner Kriesten· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
This work proposes SHAPER, a self-evolving framework for train-free embodied adaptation that keeps model parameters frozen and improves the non-parametric agent system by evolving reusable skills and a context-code harness through target-environment rollouts.
This work introduces Wiggle and Go!, a two-stage framework for zero-shot rope manipulation: a brief, safe wiggle action is observed to predict descriptive rope parameters, which then conditions a trajectory optimizer for zero-shot goal-conditioned execution.
Arthur Jakobsson, Abhinav Mahajan, Karthik Pullalarevu et al.· arXiv.org· 1 citation· ⚡1
Collective intelligence depends not only on the capabilities of individual members, but also on how those members are organized. Yet artificial multi-agent systems are typically assembled using fixed organizational structures, even when the physical tasks they perform impose fundamentally different coordination require...
Muscle-driven locomotion provides a physically grounded approach to generating realistic human movement. However, achieving both physiological plausibility and adaptability to changes in musculoskeletal capacity and external disturbances remains a fundamental challenge. To address this limitation, we propose a Reflex-I...
Jian Zhou, Xing-Yu Zhang, Rui Ma et al.· 1 citation
The overall conclusion is that formal verification is a viable complement to simulation, and could be adopted as a part of verification and validation for automated driving.
Menuka Ghalan, C. Rodgers, Zachary D. Asher· 1 citation
Imitation learning has achieved impressive results in robotic manipulation, yet most existing approaches assume clean backgrounds and lack explicit mechanisms for obstacle-aware motion generation. Extending such policies to cluttered, real-world scenes with unstructured obstacles remains a key generalization challenge....
A robotization pipeline is developed that converts heterogeneous human videos into robot-aligned observations and action trajectories while inferring missing intermediate signals across annotation levels and constructs the HuRo dataset, comprising about 630K robotized episodes and 142M processed frames from five human-...
Jinho Jeong, Se June Joo, Jaehyun Kang et al.· 2 citations
This work studies a route-conditioned order of unavoidable stages that every successful executor must traverse, recoverable from offline trajectories and belonging to none of them: a route-conditioned order of unavoidable stages that every successful executor must traverse.
A new system identifies and corrects unreliable object descriptions stored in a robot’s memory, improving the robot’s ability to interact with its environment.
Robots are getting smarter, but how can their hardware match that growth? New Microsoft Research findings show that moving AI inference beyond the robot can improve task success, boost efficiency, and support more advanced physical AI workloads. The post Offloaded inference for real-world physical AI robotics appeared first on Microsoft Research.