Efficient and Interpretable Mixtures of Experts: Statistical Inference, Initialization, and Applications
Scientific discovery increasingly relies on methods that are both flexible and interpretable. Traditional statistical models offer interpretability but depend on restrictive assumptions, whereas modern machine learning methods often sacrifice transparency for predictive accuracy. The Mixture-of-Experts (MoE) framework...