SAM3R: Object-Centric 3D Mapping via Foundation-Model-Guided Data Association in Changing Scenes
For embodied agents to navigate and reason indoor spaces, they need object-level 3D representations that stay consistent over time as new frames arrive from a monocular camera. Current online 3D instance segmentation methods either depend on posed RGB-D input with ground-truth depth or couple tightly to the internal re...