Reinforcement learning (RL) controllers have been recently adopted for Unmanned Aerial Vehicles (UAV) navigation and control. However, they are susceptible to action-space attacks that overwrite the action commands after the policy generates them and before the actuators execute them. While most existing defenses targe...
Reinforcement learning (RL) for quadruped locomotion commonly depends on fixed, hand-crafted, and Markovian reward functions that may limit interpretability of learned policies and may lack explicit control over gait behaviors. We introduce a framework where distinct gaits are specified using parameterized constraints...
Merve Atasever, Keyan Azbijari, Cagan Bakirci et al.· 0 citations
AgenticRL, a multimodal closed loop framework in which role-specialized agents generate executable rewards, diagnose failures of the resulting policies, formulate targeted refinement instructions, and regenerate improved rewards is introduced.
Roohan Ahmed Khan, Yasheerah Yaqoot, A. Habel et al.· 0 citations
PaCo-VLA is introduced, a passivity-shielded compliance prior that recasts the VLA interface, and establishes a provably sampled-passive runtime contract at the admittance port and provides a runtime interface for deploying foundation models in contact-rich domains.
Haofan Cao, Zhao-Yang Li, Zhi-Chao You et al.· arXiv.org· 3 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
This work proposes REALM, a cross-modal framework that learns an RGB- and Event-Aligned Latent Manifold by projecting event representations into the pretrained latent space of RGB foundation models, and demonstrates state-of-the-art performance in wide-baseline feature matching, significantly outperforming specialized...
Vincenzo Polizzi, David B. Lindell, Jonathan Kelly· arXiv.org· 0 citations
This work treats robosuite tasks as a software-lifecycle problem: a fixed decision layer dispatches versioned skill modules and a runtime layer was built to screen each action, which results in negative results and two measurements.
Xue Qin, Si-Min Luan, Cong Yang et al.· 7 citations
While recent Vision-Language-Action (VLA) models have begun to incorporate audio, they typically treat sound as static pre-execution prompts or focus exclusively on human speech. This leaves a significant gap in real-time, sound-centric manipulation where fleeting environmental acoustics provide critical state verifica...
Chang Nie, Tianchen Deng, Guangming Wang et al.· 0 citations
HerMES is proposed, a holistic risk-aware end-to-end multimodal driving framework that explicitly incorporates long-tail semantic knowledge into trajectory planning and demonstrates consistent improvements over representative recent baselines in overall planning performance and across diverse safety-critical scenarios.
Wei-Zhe Tang, Jun-Wei You, Jia-Xi Liu et al.· arXiv.org· 5 citations
This study presents a comparative case study of representative motion planning methods drawn from major benchmark ecosystems, including CARLA, nuPlan, and the Waymo Open Dataset to highlight the strengths and weaknesses of current approaches.
Merve Atasever, Alfredo Reina Corona, Zhuo-Chen Liu et al.· 1 citation
This work poses the choice as a three-action decision problem, act, consult your own sensors, or ask a human, whose optimal policy follows from measured accuracy, whose optimal policy follows from measured accuracy.
ForceTwin is a system for identifying physics-informed digital twins of articulated objects from instrumented human interaction that achieves 87% goal completion across nine object-embodiment pairs, compared with 60% using VLM-prior and 57% using kinematics-only twins.
Tim Engelbracht, René Zurbrügg, Mayank Mittal et al.· 1 citation
Vision-language-action policies solve the same manipulation task through different action interfaces, but task success alone does not establish whether their physical executions agree, so a low cross-policy distance does not imply interchangeability.
Xing-Yu Lin, Zhuang Li, Zhong-Run Wu et al.· 0 citations
A new system identifies and corrects unreliable object descriptions stored in a robot’s memory, improving the robot’s ability to interact with its environment.
Robots are getting smarter, but how can their hardware match that growth? New Microsoft Research findings show that moving AI inference beyond the robot can improve task success, boost efficiency, and support more advanced physical AI workloads. The post Offloaded inference for real-world physical AI robotics appeared first on Microsoft Research.