This work introduces DuoMind, a distributed hierarchical framework for multi-robot coordination through semantic communication, and develops RoboPoly, a benchmark comprising long-horizon manipulation tasks that require coordinated, closed-loop execution under distributed control.
Han-Chu Zhou, De-Chen Gao, Hang Wang et al.· 0 citations
As robotic hardware and learning methods advance, humanoids need tools to perform tasks beyond their inherent physical limits. Successful tool use requires selecting a suitable tool and coordinating manipulation and, when needed, locomotion to complete the task. Existing benchmarks do not jointly evaluate these capabil...
Kyochul Jang, Seohyeon Park, Ohchul Kwon et al.· 0 citations
This work proposes a distributed UAV-agent architecture that enables continuous local SLM control through an event-driven reason-act-observe lifecycle and approximately halves inference-token consumption, reduces transmitted data, and achieves lower survivor-count error.
Andrea Iannoli, Ivan D. Zyrianoff, A. Trotta et al.· 0 citations
This paper introduces Completion Aware Guidance (CAG), a training-free sampling method that guides generation toward task completion, and shows that this failure is not inherent to the world model backbone, but emerges when adapted for short-chunk control.
Seungyeon Kim, Junhoo Lee, Baekseung Kim et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Quadrupedal locomotion requires balancing conflicting objectives such as command tracking, stability, and energy efficiency, yet conventional reinforcement learning (RL) hardcodes these priorities into a fixed scalar reward at training time. We present PROMO (Preference-Conditioned Multi-Objective Reinforcement Learnin...
Amr Mousa, Rifny Rachman, Neil Karavis et al.· 0 citations
A hierarchical framework for spacecraft task-and-motion planning (TAMP) that grounds LLM reasoning in a graph of reusable behaviors and domain-specific planning modules is presented, establishing a scalable and auditable foundation for language-driven agentic planning of spacecraft RPO.
Yuji Takubo, Daniele Gammelli, Marco Pavone et al.· 2 citations
Vision-language-action (VLA) models struggle on history-dependent manipulation tasks, where the current observation alone does not determine the action, and the policy needs a memory of the history. Existing memory methods decide what to remember by design, for example, keeping frames with large pixel changes, and show...
Xue-Hui Yu, Eason Yu, Mei-Yi Wang et al.· 0 citations
Learned manipulation policies rediscover from data the spatial relations that rigid-body mechanics supplies in closed form. This costs data, and it leaves the policies fragile to geometric changes in the scene. We present Screw Attention, a transformer layer in which the relation between two bodies is a spatial transfo...
Autoregressive Vision-Language-Action models often represent continuous robot actions as discrete token sequences, enabling action prediction with standard next-token objectives. FAST has substantially improved this representation by compactly encoding action containing diverse temporal frequencies into relatively few...
Keisuke Shirai, Tomohiro Motoda, Hanbit Oh et al.· 0 citations
In this paper, we study how to achieve one-step action generation in Robotic Foundation Models (RFMs), aiming to overcome the high inference latency of multi-step flow matching. MeanFlow provides a promising framework for this goal, yet its direct application leads to performance collapse. We discover that this stems f...
Jiawei Fan, Sifeng Wang, Yuqing Hou et al.· 0 citations
Unsupervised skill discovery has emerged as a promising approach for leveraging reward-free datasets to pretrain general-purpose policies. However, current skill discovery methods either require access to expert data or exhibit limited generalization, failing to transfer effectively to previously unseen layouts. A key...
Mohammad Amin Abbasfar, Farbod Azimmohseni, M. Rohban· 0 citations
Vision-language-action policies often see only one or a few recent frames, which makes it difficult to evaluate how they use information that disappears during a task. We introduce MIKASA-Robo-VLA, a benchmark of 90 language-conditioned manipulation tasks. All but 10 hide the cue an action depends on. Those 10 are reac...
Egor Cherepanov, Nikita Kachaev, Aleksandr I. Panov et al.· 0 citations
A new system identifies and corrects unreliable object descriptions stored in a robot’s memory, improving the robot’s ability to interact with its environment.
Robots are getting smarter, but how can their hardware match that growth? New Microsoft Research findings show that moving AI inference beyond the robot can improve task success, boost efficiency, and support more advanced physical AI workloads. The post Offloaded inference for real-world physical AI robotics appeared first on Microsoft Research.