Open datasets describing human behavior in environments shared with mobile robots remain limited, particularly for retail activities that combine locomotion, reaching, object handling, and robot guided movement. This paper introduces OHRID Retail, an open, human centered multimodal dataset collected from 16 healthy adu...
Xiang-Rui Wang, Yue-Tong Wu, Jalen Beeman et al.· 0 citations
World Action Models (WAMs) advance beyond conventional visuomotor policies by jointly predicting future world states and robot actions, enabling the policy to learn physical dynamics that support effective control. However, recent tactile WAMs often rely on large-scale pretrained generative backbones to capture contact...
Hanchu Zhou, Brendan Lynch, Raman Goyal et al.· 0 citations
This work proposes OPTED (on-policy fine-tuning for end-to-end driving) which decouples reinforcement learning from the post-training of the end-to-end policy: a privileged teacher is trained using RL on vectorized inputs (HD-map and bounding boxes) which provides supervision to the pre-trained student during closed-lo...
D. Da Col, M. Igl, Peter Karkus et al.· 1 citation
MILER, an end-to-end policy framework with zero-shot sim-to-real transfer of both perception and control, is presented and extensively evaluated on a diverse test track comprising numerous challenges.
Thomas Steinecker, Denis Trescher, Alexander Bienemann et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Daily locomotion encompasses diverse activities and frequent transitions between them, yet most exoskeleton controllers are designed for a single activity or a narrow set of related movements. Changes in activity therefore typically require explicit mode switching and separately tuned or retrained controllers. Simulati...
Yi-Fei Yuan, Jakob H. Wolf, Ghaith J. Androwis et al.· 0 citations
Trie-GRPO, a novel reinforcement learning algorithm based on action prefix trees, which enables step-level advantage estimation, is introduced, which resolves the credit assignment problem by isolating intermediate correct decisions from downstream errors, while effectively balancing exploration efficiency and depth co...
Fei-Fan Wang, Zong-Bing Zhang, Yu Zhang et al.· 0 citations
Three key findings are shown: co-designing body and gait is necessary to satisfy locomotion constraints; actuator-envelope feasibility, rather than locomotion success alone, determines realizable payload capacity; and canonical animal gaits emerge naturally in most designs from morphology and constraints alone.
PONDERPOUNCE reuses an MLLM's native causal context and demonstrates real-world applicability on four tasks under asynchronous execution, with 60.98% mean success versus 40.67% for FrameSamp+Modul.
Suhwan Choi, Jaeyoon Jung, Sungkyung Kim et al.· 0 citations
This work introduces StarVLA-$\alpha, a simple yet strong baseline designed to study VLA design choices under controlled conditions that deliberately minimizes architectural and pipeline complexity to reduce experimental confounders and enable systematic analysis.
Jinhui Ye, Ning Gao, Sen-Qiao Yang et al.· arXiv.org· 49 citations· ⚡11
Aerodynamic promptness quantifies how rotor-speed variations generate multirotor wrench variations, but its Euclidean formulation assigns the same local cost to a given rotor acceleration at every operating speed. This work develops a capacity-aware extension for redundant multirotors with arbitrary numbers of heteroge...
SimHum is presented, a co-training recipe that extracts kinematic priors from simulation and visual priors from human observations, then fine-tunes on a small real-robot dataset, which exhibits strong scene-generalizable and data-efficient capabilities.
Kaipeng Fang, Wei Liang, Yu-Yang Li et al.· 0 citations
A neural network-based, socially compliant AV control framework that incorporates social value orientation (SVO) is proposed that enables AVs to account for their influence on HVs and traffic dynamics and promotes adaptive driving behaviors that reduce congestion, improve traffic efficiency, and lower energy consumptio...
Yu-Hui Liu, Samannita Halder, Shian Wang et al.· IEEE transactions on intelli...· 0 citations
A new system identifies and corrects unreliable object descriptions stored in a robot’s memory, improving the robot’s ability to interact with its environment.
Robots are getting smarter, but how can their hardware match that growth? New Microsoft Research findings show that moving AI inference beyond the robot can improve task success, boost efficiency, and support more advanced physical AI workloads. The post Offloaded inference for real-world physical AI robotics appeared first on Microsoft Research.