SHIFT: Step-wise History-aware Instruction Focus Tracking for Vision-and-Language Navigation
Vision-and-Language Navigation (VLN) requires an agent to ground different parts of an instruction as navigation progresses. Existing VLN agents typically revisit the full instruction at each step, leaving the locally executable span to be inferred implicitly through cross-modal attention or history representations. We...