Jul 2026
Rethinking Expert Training for Model Merging with Prompt Learning
Dual-Tuned Experts (DTEs), a two-stage training strategy that first learns prompts and then fine-tunes the vision encoder, is introduced, a two-stage training strategy that reduces the magnitude of task-specific parameter updates and produces experts with higher merge compatibility.
Christos Georgakilas, Aniello Panariello, Samir El Karrat Moreno et al.
· arXiv.org · 0 citations