FunPilot is presented, a system that enables rapid LLM-assisted diagnosis and remediation for serverless applications that uses an event-driven control loop to diagnose active symptoms, derive control knob updates, and validate remediation decisions while coordinating with the underlying autoscaler.
OpScale is presented, a practical operator-level orchestration framework of profiling, provisioning, placement, and runtime serving that attains SLOs with up to 36.3% fewer GPUs and 28% less power, or achieves 44% higher throughput under fixed cost budgets.
Xingqi Cui, Chieh-Jan Mike Liang, Ziang T. Tang et al.· 0 citations
CELLServe formalizes SLO-constrained joint resource provisioning as an optimization problem with a dedicated algorithm, and introduces an opportunistic instance merging strategy for decode phase functions to reclaim fragmented resources.
Zejian Wang, Nan Lin, Zinuo Cai et al.· ACM Transactions on Architec...· 0 citations
While serverless computing is popular, its dominant Function-as-a-Service (FaaS) model is ill-suited for stream processing because its stateless, centrally orchestrated functions cannot efficiently handle continuous, low-latency event flows. We introduce Epico, a serverless runtime explicitly designed to resolve these...
Matteo Della Bartola, Valerio Besozzi, Patrizio Dazzi et al.· 0 citations
This work asks whether a Large Language Model can replace the static routing policy itself, reading HAProxy and Prometheus telemetry every 10 seconds and isolating faulty servers through guardrailed calls to the HAProxy Data Plane API.
Fugue is a novel, self-contained reactive protocol that provides seamless and resource-efficient elasticity and reaches comparable handover performance while avoiding continuous replication overhead, and is implemented in Apache Flink.
Yu-Qiu Zhang, Yun-Hao Mao, Hans-Arno Jacobsen· Proceedings of the VLDB Endo...· 0 citations
RL-ICE is proposed as an innovative scheduler that can work in such a cloud continuum by leveraging a multi-cluster and hierarchical RL to satisfy both user Quality of Experience (QoE) metrics and tenant’s costs.
Doriana Monaco, Alessio Sacco, C. Casetti et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
