Text-conditioned sign language generation (SLG) depends not only on the generator but also on the space in which signing is generated. Existing approaches generate directly in pose space, in quantized code spaces, or in learned latent spaces trained for reconstruction. We find that these spaces are organized largely by...
Nabeela Khan, Gaurav Rai, Bo-Wen Wu et al.· 0 citations
Vision-language-action policies fine-tuned on LIBERO are trained and evaluated on the same ten instruction strings, and rewording the instruction changes base OpenVLA's success by -38.0 points, although the stronger policies lose a much smaller fraction of it than base OpenVLA.
Han-Long Li, Si-Han Tan, Takeshi Ashizawa et al.· 0 citations
Sign Language Recognition (SLR) is a crucial technology for enabling social humanoid robots to interact with Deaf and Hard-of-Hearing (DHH) individuals. However, a critical capability gap exists in current SLR-equipped systems: models cannot recognize Out-of-Vocabulary (OOV) glosses – signs not seen during training -ca...
Mayuko Sakai, Si-Han Tan, Takeshi Ashizawa et al.· IEEE International Symposium...· 0 citations
A humanoid with 5-DoF arms cannot track generic bimanual end-effector trajectories with its arms alone; pelvis and waist motion must be recruited, but which motion, and when, is not uniquely determined. On a Unitree R1 in fixed double support, the set of dynamically valid recruitment strategies (pelvis pose and waist t...
Han-Long Li, Si-Han Tan, Takeshi Ashizawa et al.· 0 citations
To enable bidirectional mapping between text and sign, SignFLIP adopts a symmetric architecture together with a stage-wise training strategy built on large-scale data, which shows competitive performance compared with task-specific models on both translation and generation tasks, as well as strong transferability to si...
Zhaoyi An, Si-Han Tan, Youngbae Hwang et al.· Conference on Empirical Meth...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.