Measure the Deployment, Not Just the Model: Rethinking Hardware-Aware Model Selection for Microcontrollers
CREST (Cross-platform Runtime Evaluation and Search Tool), an open-source hardware-in-the-loop experimentation system that evaluates model and hardware configurations under a specified release schedule that can vary the objective, schedule, target and candidate proposer while reusing evaluation and replay.