Dragonfly-Ultra: A Scalable, Low-Cost Network Architecture for High-Performance AI Clusters
Dragonfly-Ultra is presented, a scalable, low-cost network architecture for high-performance AI clusters that can scale to over 260k GPUs with only 82% cost and 81% power consumption of a 3-layer Clos architecture and incorporates three key mechanisms to further improve network performance and optimize collective communication.