Accuracy and Robustness of Model Cascades Under Data Perturbations
These findings demonstrate that energy efficient model cascades require evaluation beyond clean accuracy, with explicit attention to routing reliability under distribution shift, and select a model cascade at the pareto-optimum of accuracy, routing quality, and energy consumption that achieves competitive predictive performance with an up to 10-fold decrease in CO2 emissions.
Pallavi Mitra, J. Kushwaha, F. Biessmann
· 0 citations