Timothy Barclay

If, Then, Otherwise: Diagnosing Conditional Branching in Vision-Language Navigation

Vision-language navigation agents are often evaluated on their ability to follow route-like instructions toward a fixed goal. Yet, real navigation instructions often depend on observed states of the environment: if a condition holds, then follow one path, otherwise take another. Such instructions require an agent to ev...