Reproducible LLM Inference Benchmarking: A Sequential Isolation Protocol for Regression Testing
Reproducible benchmarking of Large Language Model (LLM) inference is challenging because repeated measurements can vary with execution and system state. We present the Sequential Isolation Methodology, a controlled benchmarking and regression-testing protocol designed to reduce between-run measurement variance while de...
Arnold Olympio, Juan Manuel Servera Bondroit, Wael Abdelmalek et al.
· 0 citations