Egocentric video provides a continuous first-person record of everyday activities, making it a natural foundation for wearable AI assistants. Unlike offline video understanding, streaming systems must process observations as they arrive, while queries may refer to experiences from the distant past. Recent work has begu...
Hao-Kai Pang, Yu-Qian Fu, Yi-Fei Wang et al.· 0 citations
Egocentric video understanding spans diverse capabilities, modalities, and evaluation formats, yet these are often studied in isolation despite their tight coupling in real-world interaction. We propose the Ego-Action-World interaction loop as a unifying principle: the wearer perceives the world, forms goals, acts, cha...
Song-Ruo Chen, Yu-Qian Fu, Yu Li et al.· 0 citations
3D Gaussian Splatting (3DGS) represents 3D content with anisotropic primitives that jointly encode geometry and appearance. Fixed-budget encoders consume sampled observations of Gaussian assets, so the same object may be observed through different primitive realizations. Existing self-supervised methods mainly reconstr...
This work argues that streaming video memory should explicitly encode structured and semantically meaningful representations, particularly at the entity level, and proposes MEMO, a novel framework that models streaming video through multi-level, entity-aware structured memory.
Yin-Ying Li, Yu-Qian Fu, Yu-Lin Dai et al.· 1 citation
Streaming video understanding requires models to continuously retain useful visual evidence before future questions are known. Existing approaches primarily manage the growing visual context according to token importance, temporal redundancy, or segment-level relevance, but rarely organize evidence around objects that...
Mingkang Dong, Muxin Pu, Jie Li et al.· arXiv.org· 1 citation
A cross-domain egocentric video question answering benchmark designed to evaluate whether multimodal large language models can generalize beyond common daily-life scenarios, and two official Codabench tracks.
Yu-Qian Fu, Tianwen Qian, Yanjun Li et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
