EYRO - AI Glasses: A Unified Multimodal Assistive Navigation Prototype
Abstract
EYRO is a prototype assistive-navigation system designed to combine visual perception, speech interaction, task management, and audio guidance for people with visual impairment. Unlike systems that concentrate on a single capability, the implementation integrates walkable-area segmentation, obstacle detection, crosswalk and traffic-light assistance, openvocabulary object search, hand-guided localization, experimental Indian currency recognition, browser-based map navigation, and fail-safe health monitoring under one task-controlled application. The software runs primarily on a Windows laptop and accepts camera and microphone input from local devices or optional network-connected hardware. A NavigationMaster state machine coordinates the active task so that only one primary guidance workflow is executed at a time, while a reduced-rate obstacle safety layer can remain active during selected temporary tasks. The implementation uses SegFormer-B0 for walkablearea segmentation, YOLO11n for obstacle and traffic-related detection, YOLOE for open-vocabulary search and banknote localization, ByteTrack for object tracking, MediaPipe HandLandmarker for hand guidance, faster-whisper for speech recognition, pyttsx3/SAPI5 for speech output, OpenRouteService for map routing, and optional MobileNetV3-Small classifiers for currency denomination and authenticity estimation. The system deliberately avoids unverified safety claims: an unclear traffic light remains UNKNOWN, a nearby-vehicle estimate is treated as a visual proxy rather than distance or speed, and currency output is explicitly an AI estimate. This paper presents the engineering design, module-level methodology, statemachine logic, implementation decisions, comparison with a recent smart-glasses base paper, and an evaluation framework. Because project-specific benchmark measurements and controlled user-study results were not supplied in the source materials, no fabricated accuracy, latency, FPS, or user-performance values are reported