Skip to content
Conference

Learning Effective Sign Features without Text for Gloss-free Sign Language Translation

2026 · Computer Vision and Pattern Recognition · pp. 9827-9836 · 2 citations · 48 references
Computer Science

TL;DR

SignDINO is introduced, a simple yet effective sign-aware DINO training strategy that learns effective and semantically meaningful sign-aware DINO training strategy, and only global frames are required during inference for simplicity.

View source

Similar papers

#computer vision Preprint Oct 2026

SignRAG: Unified Retrieval-Augmented Gloss-Free Sign Language Translation

Contemporary decoder-only large language models (LLMs) have demonstrated strong capabilities across a wide range of domains. However, existing pretraining paradigms for gloss-free sign language translation (SLT) are largely designed around conventional encoder-decoder pretrained language models, which limits their dire...

Zhi Rao, Yucheng Zhou, Qian-Ran Sun et al. · 0 citations
#computer vision Open access Sep 2026

SignFLIP: A Unified Model for Sign Language Translation and Generation via Stage-wise Alignment at Scale

To enable bidirectional mapping between text and sign, SignFLIP adopts a symmetric architecture together with a stage-wise training strategy built on large-scale data, which shows competitive performance compared with task-specific models on both translation and generation tasks, as well as strong transferability to si...

Zhaoyi An, Si-Han Tan, Youngbae Hwang et al. · 0 citations
Review Open access Sep 2026

Deep Learning-Based Sign Language Translation: A Survey and Taxonomy

Sign Language Translation (SLT) is crucial for communication between Deaf or Hard-of-Hearing communities and society. Advances in deep learning have enabled promising sign-to-text systems, yet progress remains constrained by limited data, complex spatiotemporal dynamics, and non-manual cues. This survey reviews deep le...

De-Sen Yuan, Rui-Li Wang · 0 citations
Book Open access Nov 2026

Toward In-the-Wild Gloss-Free Sign Language Translation via Domain-Adaptive Cross-Modal Alignment

Enabling gloss-free sign language translation (SLT) in unconstrained real-world environments is a critical step toward practical deployment. Existing progress has been driven primarily by benchmarks collected in visually homogeneous laboratory settings, where simplified scenes substantially reduce the difficulty of cro...

Chang-Hao Lai, Yue-Gan Yi, Rui Zhao et al. · 0 citations
Sep 2026

SignGPT: Toward LLM-Mediated Sign Language Interaction through Gloss-Free Translation and Generation

SignGPT is presented, a unified, pose-based framework for gloss-free SLT and SLG that integrates part-aware hierarchical representations of body, hand, and facial motion into a shared language model and employs asymmetric multi-token prediction and progressive training for bidirectional modeling.

Rong-Hui Li, Jun Dong, Zhong-Yuan Hu et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.