RoboTalk: Learning Multi-Robot Communication and Coordination from Multimodal Demonstrations
RoboTalk is introduced, a synthetic data-generation pipeline and dataset of 7,950 multimodal trajectories spanning 53 mobile-manipulation kitchen tasks for training small VLMs to communicate and coordinate and fine-tuning open-source models on this dataset can reach 77% success on novel held-out tasks.
Dorian Benhamou Goldfajn, Mason Nakamura, Saaduddin Mahmud et al.
· 0 citations