A metric interaction framework that models object-level and scene-level interactions in physical Cartesian space at a shared metric scale and improves diverse VLA and WAM baselines with a small number of additional parameters and training steps is introduced.
Li-Jie Wang, Zheng Lu, Yi-Ming Wang et al.· 0 citations
This work instantiates Real-Time EXPO-FT, an RL framework for finetuning real-time VLA policies that meets the real-time control requirements of dynamic real-world manipulation, demonstrating rapid, sample-efficient adaptation to challenging real-world dynamics.
Perry Dong, Kuo-Han Hung, D. Sadigh et al.· 2 citations
The results show that replay retention depends on change magnitude and on how the dynamics evolve, and an estimator built from interaction data can still provide the quantities needed to choose a replay strategy after permanent changes.
Everest Yang, Skye Thompson, G. Konidaris· 0 citations
For the datasets and models considered, pixel-level image-fidelity metrics alone may not consistently capture the task-relevant realism of synthetic sonar observations and motivate the use of task-aware evaluation for synthetic sensor data intended for robotic perception.
Hannan Ejaz Keen, M. Fraz, Karsten Berns· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Fine-tuning a Vision-Language-Action (VLA) model for a new deployment environment is expensive, yet most methods apply uniform-capacity adapters to every network region as if every region requires equal adjustment. This paper tests that assumption on five architecturally diverse VLAs (OpenVLA-OFT, $\pi_0$, SmolVLA, DTP...
Shahram Najam Syed, Arthur Jakobsson, Prayuj Sachdev et al.· 0 citations
FedGuide is proposed, a FRL framework that uses diffusion priors as behavior models to provide personalized data supported distributions for heterogeneous local policy learning and develops a Distribution Correction Estimation value baseline to provide low-variance, return-aware guidance for local policy improvement.
These results give expected policy-loss consistency for the fixed-horizon generative-reset approximate-ERM procedure with exact action scores and provide an explicit residual-decay criterion for FIFO/interleaved SGD.
CloudEdgeVLA is introduced, a cloud-edge policy that treats temporal misalignment as a representation-learning problem and offers a practical route to scalable VLA deployment in which cloud models can grow while edge computation remains lightweight and responsive.
Dao-Jie Peng, Fu-Long Ma, Bing-Tao Wang et al.· 1 citation
EfficientTDMPC is introduced, a sample-efficient model-based reinforcement learning method for continuous control built on the TD-MPC family of algorithms that is the new state of the art in sample efficiency on HumanoidBench and the DeepMind Control Suite.
T. Evers, Cristian Meo, Wendelin Böhmer et al.· arXiv.org· 2 citations
PACT-WAM is introduced, a world-action model that jointly generates a 16-step action trajectory and its temporally corresponding visual forecast through conditional flow sampling, andlations show that hierarchical history allocation and joint action-visual generation improve control success.
Yu-Shan Liu, Jing-Jing Fan, Shou-Jie Li et al.· 3 citations
Deploying multiple machine learning models on resource-constrained robotic platforms for different perception tasks often results in redundant computations, large memory footprints, and complex integration challenges. In response, this work presents Visual Perception Engine (VPEngine), a modular framework designed to e...
Jakub {\L}ucki, Jonathan Becktor, Georgios Georgakis et al.· 0 citations
A novel vision-language model (VLM)-based navigation framework that addresses challenges by adaptively retrieving task-relevant cues from a global memory module and integrating them with the agent's egocentric observations and enhances spatial reasoning and decision-making in long-horizon tasks.
A new system identifies and corrects unreliable object descriptions stored in a robot’s memory, improving the robot’s ability to interact with its environment.
Robots are getting smarter, but how can their hardware match that growth? New Microsoft Research findings show that moving AI inference beyond the robot can improve task success, boost efficiency, and support more advanced physical AI workloads. The post Offloaded inference for real-world physical AI robotics appeared first on Microsoft Research.