SignGPT: Toward LLM-Mediated Sign Language Interaction through Gloss-Free Translation and Generation
SignGPT is presented, a unified, pose-based framework for gloss-free SLT and SLG that integrates part-aware hierarchical representations of body, hand, and facial motion into a shared language model and employs asymmetric multi-token prediction and progressive training for bidirectional modeling.