Dmitry Berenson

Topology-Informed Visual Prompting For Vision Language Action Policies

This work presents a topology-guided visual-prompting framework that uses simulation-based planning to augment a nominal demonstration dataset and provides vision-based guidance at deployment and outperforms a VLA fine-tuned only on nominal demonstrations and a VLM-prompting baseline that can remove topology-relevant i...