Skip to content

Grounding Agent-Driven Code Optimization in Production Telemetry

· 0 citations · 10 references

TL;DR

DODO (Datadog Observability-Driven Optimizer), a system that closes this gap by grounding the benchmark in live production telemetry and iterating a Go micro-benchmark until its execution shape matches production at ≥ 98% similarity.

View source

Similar papers

Preprint Aug 2026

LLM4LLM: Bridging Kernel Benchmarks and Real Deployment via Closed-Loop Agentic Optimization

LLM4LLM is introduced, a deployment-aware closed-loop optimization framework that starts from a target inference script, extracts phase-aware optimization tasks, searches with an experience-guided episodic agent, and accepts patches through in-model validation.

Hui Zeng, Pengfei Yang, Yanxin Chen et al. · 0 citations
Preprint Aug 2026

HarnessOpt-Bench: Evaluating LLMs at Harness Optimization

This work evaluates 5 frontier LLMs as optimizers both under a shared coding harness and under their native harnesses across 4 downstream tasks, and establishes harness optimization as a measurable and discriminative capability with large space for improvement.

Varun Ursekar, Apaar Shanker, Yash Maurya et al. · 5 citations
Preprint Aug 2026

Benchmarking LLM-Guided Control-Plane Policies for Backend Fault Isolation in HAProxy

This work asks whether a Large Language Model can replace the static routing policy itself, reading HAProxy and Prometheus telemetry every 10 seconds and isolating faulty servers through guardrailed calls to the HAProxy Data Plane API.

A. Chauhan, Vishnu S Pendyala · 0 citations
#machine learning Preprint Sep 2026

Code-to-Harness: Distilling Black-Box Optimizers from Self-Play

This work studies low-budget black-box optimization, where unaided language models remain well below strong classical optimizers and attains the lowest regret on a sealed YouTube reward-tuning production benchmark.

Yi Wu, Zheng Ren, Zhi-Yu Hu et al. · 0 citations
Preprint Aug 2026

Evaluating Agentic Code Repair Capabilities in Distributed Systems

DDBench is introduced, a code-repair benchmark of 60 historical bugs mined from 13 open-source distributed systems, partitioned into three difficulty tiers, isolating the effect of debugging context from model capability.

Yi-Bo Yan, Huijuan Wang, Jun-Zhou He et al. · 0 citations
Preprint Aug 2026

Accelerated Genetic Programming Hyper-Heuristics for Simulation-Based Scheduling via Agentic AI

This paper presents a systematic refactoring approach using Claude agentic AI on real-world project-scheduling workloads in a high-performance computing (HPC) environment, where the agent identifies bottlenecks, implements targeted optimizations, and evaluates their effects, while the researcher retains final control.

H. Li, A. Pletzer, Yuan Tian et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.