Mark-Anthony Moisescu-Pareja

New Multiple Descent Phenomena Induced by Heterogeneous Data

Modern machine learning models are often trained on large datasets assembled from many different sources, whose statistical properties can differ substantially. Understanding how this heterogeneity affects generalization performance is therefore important for explaining how model performance changes as model size incre...