Open access
Sep 2026
Compute-Communication Overlap Is Not Free: A Cross-Layer Characterization in GPU LLM Workloads
Distributed large language model (LLM) systems rely on compute-communication (CC) overlap to hide communication overhead. However, scheduling compute and communication concurrently and maximizing overlap opportunities do not guarantee effective overlap. Resource contention can slow concurrent operations, while communic...
Jihwan Oh, Junkyum Kim, Seokjin Go et al.
· IEEE International Symposium... · 0 citations