TRANSIT is a transparent scale-in framework to enable multi-node model training on fewer GPUs while maintaining training efficiency by transparently leveraging CPU DRAM as an extension of GPU memory during distributed training. It achieves this through a user-space interposition layer, requiring no modifications to the...
Hyungyo Kim, Nicholas Satchanov, Hrishi Shah et al.· 0 citations
LLQM (Low-Level Quantum Machine), a profiling-driven meta-framework for quantum-classical pipelines that decomposes pipelines into fine-grained tasks and continuously profiles their CPU/GPU, memory, QPU, and queue dependencies alongside real-time hardware states, is presented.
Ayush Bansal, Owen Cochell, Santiago Núñez-Corrales et al.· 0 citations
This paper builds a system, REACT, that tunes the recurring pattern of data exchange between GPU nodes (known as communication collectives) in response to congestion, and improves communication performance by 13%-38% under network congestion.
Eashan Gupta, Yong-Zhou Chen, Apoorve Mohan et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.