We study post-training for dynamically routed mixture-of-experts (MoE) models, focusing on integrating independently optimized specialists while keeping consolidation efficient. Our approach combines calibrated multi-teacher on-policy distillation (C-MOPD), which matches each selected teacher on a local Top-$K$ support...
Yue He, Jia-Hui Hu, Sha-Man Tang et al.· 0 citations
This work introduces Trion-1, the first native, unified, multimodal diffusion language model (dLLM) for proteins, which unifies six core capabilities: folding, inverse folding, sequence understanding, structure understanding, sequence design, and structure design, while retaining the native language capabilities of gen...
Tian-Yu Lu, Kai-Cheng Yang, Jiang-Tao Feng et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.