Not All AI Agents Are Equal: Characterizing Resource and Performance Dynamics
The latency with respect to the resource dynamics of processing multiple requests and tasks concurrently is characterized and new optimization opportunities that exploit the resource dynamics of tasks are demonstrated: CPU-aware tool admission and task-aware CPU allocation.
Wonmi Choi, Minuk Park, Zhixiong Niu et al.
· 0 citations