Preprint
Oct 2026
ServeTwin: A Benchmark-Validated Simulator for Distributed LLM Architecture Exploration
Evaluating distributed LLM serving designs on physical clusters is costly. Yet existing simulators provide only subsets of the capabilities needed for realistic design exploration: stateful closed-loop execution, timing prediction without profiling target hardware, and direct execution of unmodified serving benchmarks....
Sungjoon Park, Chang-Yong Jung, Kyung-No Joo et al.
· 0 citations