BrownoutMoE: Structure-Aware Expert Grouping for Efficient and Accurate LLM Web-based Services
Inspired by the brownout paradigm in service computing, BrownoutMoE reorganizes experts into groups to improve utilization and system efficiency while maintaining service quality and introduces a grouping-consistent distillation process to produce deployable models that are compatible with standard inference pipelines.