CeeTrain: Fast Geo-Distributed Model Training Across Heterogeneous GPUs and Networks in Cloud-Edge-End Computing Environments
Most existing training systems focus on a single region. In contrast, we envision that cross-region training offers more flexible GPU resource allocation and yields significant potential. However, the hierarchical cluster topology and unstable networks in the cloud-edge-end (CEE) environment, a typical cross-region sce...
Jin-Quan Wang, Xiao-Jian Liao, Xu-Zhao Liu et al.
· IEEE Transactions on Paralle... · 0 citations