Jiawei Guan

Parallel-Aware Early-Stopping Metrics for Hyperparameter Optimization

Parallel and distributed HPO systems evaluate many configurations concurrently, but their throughput depends heavily on when a scheduler stops weak trials and reallocates scarce CPUs, GPUs, and memory. Existing systems commonly rank live trials by validation loss, treating the early-stop metric as an implementation det...