MoSim is introduced, a GPU-cluster simulator that models DT job execution under dynamic network contention, which reduces simulation error for average JCT by up to 3.28%, and reduces input construction overhead by 44.6% by avoiding real-GPU profiling.
Yeonho Yoo, Hyunho Lee, Hyun-Eem Choi et al.· 0 citations
Xronos is proposed, a collaborative fine-tuning framework for heterogeneous CPU edge devices that uses TP as its execution backbone and combines lightweight profiling with heterogeneity-aware tensor partitioning to reduce the straggler bottleneck.
Wonmi Choi, Sunjae Park, Dohyeok Kwon et al.· 0 citations
PARSER is a new residual sparsification method that shifts the compression objective from minimizing isolated matrix errors to preserving the expert output error, and achieves this by introducing output importance, which measures the actual contribution to the expert output error.
Seung-Woo Jung, Dohyeok Kwon, Seung-Min Cha et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.