This paper builds a system, REACT, that tunes the recurring pattern of data exchange between GPU nodes (known as communication collectives) in response to congestion, and improves communication performance by 13%-38% under network congestion.
Eashan Gupta, Yong-Zhou Chen, Apoorve Mohan et al.· 0 citations
This work presents Meta's network architecture and software stack designed to support one of the world's largest RoCE fabrics, currently connecting over 100,000 GPUs across multiple datacenter buildings, and introduces a scalable initialization strategy that reduces startup times by 11× via eager process group creation...
Hongyi Zeng, Min Si, Pavan Balaji et al.· Conference on Applications,...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.