Recent advances in sign language understanding have achieved impressive success on short, single-sentence videos, yet their performance drops sharply when applied to long, continuous sign language videos. To bridge this gap, we focus on a challenging and realistic setting: Visual-only Sentence-level Sign Language Segme...
Bo-Wen Guo, Shi-Wei Gan, Ya-Feng Yin et al.· 0 citations
Uni-SLTP is proposed, a unified framework for SLT and SLP with two key components: a shared sign tokenizer that converts sign sequences into discrete tokens and latent representations, capturing both semantic and reconstructive information.
Xiao Liu, Shi-Wei Gan, Ya-Feng Yin et al.· 0 citations
A new task, Sign Language Question Answering (SLQA), which evaluates SL understanding by requiring models to answer arbitrary natural language questions about SL videos, and a simple yet effective baseline model equipped with a Question-Conditioned Modulated Temporal Downsampling module and an in-domain knowledge trans...
Shi-Wei Gan, Li-Chen Wang, Xiao Liu et al.· arXiv.org· 2 citations
SignDINO is introduced, a simple yet effective sign-aware DINO training strategy that learns effective and semantically meaningful sign-aware DINO training strategy, and only global frames are required during inference for simplicity.
Shi-Wei Gan, Xiao Liu, Ya-Feng Yin et al.· Computer Vision and Pattern...· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.