Reika Kinoshita

Performance Characterization of LLM Inference under Limited GPU Resources

With the widespread adoption of large language models (LLMs), the demand for graphics processing units (GPUs)-essential for accelerating LLM training and inference- has increased significantly. This has led to rising procurement and operation costs, imposing a significant financial burden on research institutions and i...