GPU resource management policies govern how a system places memory and schedules GPU tasks. They play an important role in determining application performance, and the ideal policy for a given deployment often depends on low-level details such as the application, workloads, and hardware. AI agents would make it possibl...
Yu-Sheng Zheng, Tong Yu, Yi-Wei Yang et al.· Proceedings of the 32nd ACM...· 0 citations
Kamera is presented, a system for testing CCPs that uses partial simulation to execute the code of multiple interacting controllers against a lightweight model of the Kubernetes runtime and achieves a 1,781× speedup over existing cluster-based controller testing approaches.
Tim Goodwin, Lindsey Kuper, Andi Quinn· Proceedings of the ACM SIGOP...· 0 citations
AgentPProf is a profiler that aggregates agent trajectories into pprof-compatible profiles, enabling flame graph visualization and analysis and introduces recursive operation segmentation, which recursively splits trajectories at task boundaries.
Yu-Sheng Zheng, Chaokun Chang, Yuan-Man Mao et al.· 0 citations
High-Bandwidth Flash (HBF) places high-capacity NAND beside HBM to relieve the memory-capacity bottleneck of LLM inference, yet its system-level behavior cannot be evaluated before hardware becomes available. Cycle-level GPU simulators are too slow for production-scale models. Trace replay has a further shortcoming: it...
Yan-Peng Hu, Yi-Wei Yang, Yuan-Wu Zhu et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.