Author

Nan-Yun Peng

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence Preprint Oct 2026

Cross-Lingual Alignment for Decoder-Only Models using MoE Routers

Cross-lingual contrastive learning has been a core component of multilingual encoder training, but the ability to explicitly align representations is not possible in decoder-only LLMs because of varying multilingual tokenization. However, a growing amount of research suggests that even in LLMs, higher cross-lingual rep...

Lucas Bandarkar, C. Peng, A. H. Ahmed et al. · 0 citations

#artificial intelligence Preprint Sep 2026

Multilinguality in Hybrid Attention LLMs

This work presents a first study of how hybrid attention impacts the multilinguality of LLMs, showing that cross-lingual representations in hybrid models develop in patterns tied to the ordering of recurrent and full-attention layers.

Lucas Bandarkar, Jun-Ling Hu, Chen-Yuan Yang et al. · 0 citations