This work introduces BOTTLED, a benchmark in which agents receive an entire unlabelled workload and must complete it under fixed time, compute and LLM API budgets, and finds that strong zero-shot task performance does not reliably translate into strong bottling capabilities.
Ankit Sonthalia, Haritz Puerto, Alexander Rubinstein et al.· 0 citations
A hijacking experiment is designed that grafts hidden states of the target model into an oracle trained only on the retain set, which serves as a plug-and-play component that further improves existing methods.
Yejin Kim, William F. Shen, Seokwon Jung et al.· 0 citations
Data attribution methods using gradient similarity are widely used to analyze and select training data for large language models, but what gradient similarity actually measures is debated. Some interpret it as identifying task-relevant skills, while other work reports that surface form is the main factor. We resolve th...
Sunwoo Kim, Seokwon Jung, Sohyung Kim et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.