IndustrialRemembr, a shared spatiotemporal memory system that extends NVIDIA ReMEmbR to robot fleets and reduces server-side computation by generating scene descriptions only on demand, is presented.
Jad Yammine, Malek Wahidi, Abrar Anwar et al.· 0 citations
Simulation is a powerful tool for robotics, but building diverse, simulation-ready scenes at scale remains difficult. Reconstructing scenes from single images is a promising alternative, but visual similarity alone is insufficient: objects must also be recovered, accurately placed, and physically grounded. Existing met...
Run-Dong Luo, Yu-Nong Liu, Dian-Long Cao et al.· 0 citations
Humanoid-human interaction requires robots to operate under severe partial observability: during close physical contact, the human partner is occluded, truncated, or outside the robot's field of view, causing pose estimation to fail and often necessitating external tracking or privileged human state. At the same time,...
Yuto Shibata, Kotaro Amaya, Kashu Yamazaki et al.· 0 citations
World-Action Models (WAMs) have emerged as a promising paradigm for embodied generalist policies by jointly modeling future world evolution and robot actions across diverse manipulation tasks. However, representing diverse futures is only the first step: a capable WAM must also generate futures that match the requireme...
Zhuo-Hao Li, Jia-Wei He, Yu-Xiang Yan et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
The results separate hazard perception from hazard control in driving VLAs, show that unsafe behavior can arise even when the model has both the evidence and the ability to act on it, and propose a simple fix for bridging this binding gap.
Matteo Cercola, Ka-Tie Z. Luo, Simone Formentin et al.· 0 citations
Cascade world-action models (WAMs) use predicted visual futures to condition robot actions, but inherit costly iterative inference from diffusion-pretrained experts. We ask what a single-step predicted future must preserve to support accurate single-step action prediction. In the evaluated WAM, resampling video noise h...
Shao-Yi Zheng, Zhong-Tao Jiang, Yue Peng et al.· 0 citations
The proposed HuTact framework, a framework that pretrains tactile-aware hand representations from human HOI data without requiring real tactile signals during pretraining, suggests that human interaction data can serve as a scalable complementary source for robotic tactile representation learning.
In object goal navigation (ObjectNav), an embodied agent must find a target object (e.g., "find a bed") in a previously unseen environment, relying on spatial commonsense such as object co-occurrence. Large Language Models (LLMs) encode this commonsense, but deploying them on robots exposes a trade-off between reasonin...
Pengying Wu, Zhejia Wen, Kang Ding et al.· 0 citations
It is shown that a single egocentric camera worn on the collector's head replaces the wrist camera, the pose tracker and their separate streams with one, and the full co-trained head-camera policy succeeds in 20/25 against 15/25 for the wrist-camera recipe, and 12/25 for a fixed camera.
An optional runtime safety check is added to the loop: before the first motion, the model is asked whether it would carry out the instruction, given the same camera frames, and the check would have stopped all 15 hazardous instructions, including the 4 that completed the harm, and flagged none of the 15 harmless contro...
A novel method is presented that enables a semi-autonomous, camera-equipped robot to recognise the task goal and plan actions to achieve it, and a solver is developed that uses a vision-based Large Language Model to convert photos of a Shoebox Task into a Planning Domain Definition Language (PDDL) representation and ge...
Pluralistic alignment requires AI systems to learn from diverse populations whose preferences may reflect heterogeneous or even conflicting objectives, and to personalize their behavior to individual users. Existing approaches in pluralistic alignment often assume access to annotator identities and rely on powerful pre...
Akansha Kalra, Ellen R. Novoseller, Vernon J. Lawhern et al.· 0 citations
A new system identifies and corrects unreliable object descriptions stored in a robot’s memory, improving the robot’s ability to interact with its environment.
Robots are getting smarter, but how can their hardware match that growth? New Microsoft Research findings show that moving AI inference beyond the robot can improve task success, boost efficiency, and support more advanced physical AI workloads. The post Offloaded inference for real-world physical AI robotics appeared first on Microsoft Research.