Conference
Jul 2026
Performance Characterization of LLM Inference under Limited GPU Resources
With the widespread adoption of large language models (LLMs), the demand for graphics processing units (GPUs)-essential for accelerating LLM training and inference- has increased significantly. This has led to rising procurement and operation costs, imposing a significant financial burden on research institutions and i...
Madoka Takato, Akira Hirai, Reika Kinoshita et al.
· Annual International Compute... · 0 citations