2026· Computer Vision and Pattern Recognition· pp. 9827-9836· 2 citations· 48 references
Computer Science
TL;DR
SignDINO is introduced, a simple yet effective sign-aware DINO training strategy that learns effective and semantically meaningful sign-aware DINO training strategy, and only global frames are required during inference for simplicity.
Contemporary decoder-only large language models (LLMs) have demonstrated strong capabilities across a wide range of domains. However, existing pretraining paradigms for gloss-free sign language translation (SLT) are largely designed around conventional encoder-decoder pretrained language models, which limits their dire...
Zhi Rao, Yucheng Zhou, Qian-Ran Sun et al.· 0 citations
To enable bidirectional mapping between text and sign, SignFLIP adopts a symmetric architecture together with a stage-wise training strategy built on large-scale data, which shows competitive performance compared with task-specific models on both translation and generation tasks, as well as strong transferability to si...
Zhaoyi An, Si-Han Tan, Youngbae Hwang et al.· Conference on Empirical Meth...· 0 citations
Sign Language Translation (SLT) is crucial for communication between Deaf or Hard-of-Hearing communities and society. Advances in deep learning have enabled promising sign-to-text systems, yet progress remains constrained by limited data, complex spatiotemporal dynamics, and non-manual cues. This survey reviews deep le...
Enabling gloss-free sign language translation (SLT) in unconstrained real-world environments is a critical step toward practical deployment. Existing progress has been driven primarily by benchmarks collected in visually homogeneous laboratory settings, where simplified scenes substantially reduce the difficulty of cro...
Chang-Hao Lai, Yue-Gan Yi, Rui Zhao et al.· 0 citations
SignGPT is presented, a unified, pose-based framework for gloss-free SLT and SLG that integrates part-aware hierarchical representations of body, hand, and facial motion into a shared language model and employs asymmetric multi-token prediction and progressive training for bidirectional modeling.
Rong-Hui Li, Jun Dong, Zhong-Yuan Hu et al.· arXiv.org· 0 citations