RealityBench: Simulated Environments to Evaluate a Vision Language Model's Ability to Document Human Physical Work
Augmenting worker capabilities in the physical world through guidance has been a decades-long goal for AI agents. One key supporting capability is to understand what the worker is doing, seeing through the human's camera or smart glasses, and assist them in documentation. Despite advances in vision language models, the...
Andrew Perrault, Anmol Takiar, Dominik Wienecki et al.
· 0 citations