Today, AI cloud is key to serving diverse users with AI services, where cloud networking forms the basis. In this paper, we share our experience in designing, deploying, and operating Pegasus, a data center network tailored for the AI cloud, along with operational lessons learned from its deployment. The key designs of Pegasus include: 1) Network virtualization: a DPU-RNIC decoupled collaborative hardware architecture to enable a single DPU to virtualize multiple RNICs while reducing the power consumption. We design two-level flow tables on both DPU and RNICs to support underlay-overlay IP address translation and ensure isolation. For DPU-RNIC communication, we introduce a per-RNIC communication state machine to reduce communication overhead. 2) Network transport: customized and transparent transport offloading in the RNIC for low-latency and high-throughput communication performance for various AI workloads. We carefully offload per-packet load balancing and credit-based congestion control in RNICs, optimizing reorder delay and eliminating the impacts of hardware jitter. Pegasus has been deployed in production for over two years, currently covering 8K GPUs and supporting a wide range of tenants' AI applications.
Xianneng Zou, Yadong Liu, Yiran Zhang et al.· Proceedings of the ACM SIGCO...· 0 citations
As 6G networks advance toward higher levels of autonomy and intelligence, the demand for sophisticated multimodal data processing in communication systems is growing exponentially. Conventional localized AI models encounter significant generalization bottlenecks when handling cross-layer network operations and dynamic resource allocation. To overcome these limitations, this paper systematically investigates the application frameworks of large language models (LLMs) in wireless communication systems—spanning from physical-layer protocols to high-layer network management—while critically evaluating the associated deployment challenges. Drawing on a comprehensive review of prominent literature published over the past three years, this study empirically assesses the performance of diverse LLM architectures across three key domains: physical-layer protocol parsing, network-layer resource allocation, and service orchestration. Results demonstrate that LLMs yield substantial improvements in end-to-end semantic communication, standardized protocol interpretation, and intelligent network resource scheduling. Nevertheless, practical deployment remains severely hindered by the computational constraints of edge devices and prohibitively high inference latency. We conclude that the co-design of lightweight, telecom-specific large language models (Telecom-LLMs) and distributed inference mechanisms constitutes a pivotal evolutionary pathway toward realizing endogenous intelligence in future wireless communication systems.
Chunxuan Zhao· Applied and Computational En...· 0 citations