A Preliminary Study on Simultaneous Coscheduling for Discrete GPU vs. Fused GPU
TL;DR
This preliminary study evaluates coscheduling on the NVIDIA GH200 Superchip compared to a discrete H100 PCIe platform to suggest that integrated CPU–GPU platforms such as GH200 can improve both performance and programmability for coscheduled workloads.
Abstract
CPU-GPU coscheduling enables simultaneous execution of an application across both processing units, but its efficiency depends on workload partitioning and memory architecture. This preliminary study evaluates coscheduling on the NVIDIA GH200 Superchip compared to a discrete H100 PCIe platform. Using sparse conjugate gradient (CG) as a case study, we assess various work divisions across three memory-management paradigms: explicit copy, managed memory, and mapped memory. Our evaluation highlights the run time and programmability tradeoffs of reducing manual CPU–GPU data movement. The results show that compared with the H100 PCIe platform, GH200 makes several hybrid CPU–GPU work divisions competitive and makes managed memory practical for several matrices. These results suggest that integrated CPU–GPU platforms such as GH200 can improve both performance and programmability for coscheduled workloads.