Daichi Yashima

STARE: Scene Text-Aware multimodal Retrieval for Everyday objects

In this study, we focus on service robots that retrieve and transport everyday objects based on free-form instructions that may refer to visual features and scene text. This is challenging because it requires a multimodal understanding of the visual features and spatial relationships of objects, as well as scene text e...