This work benchmarking nine dense encoders and BM25 over two corpora, three indexing modes and two evaluation protocols for Classical Arabic poetry shows that which retriever wins is governed by how much of a poem's wording the query still carries.
Omar Farouk Zouak, S. Mani, Larbi Said Chikh et al.· 0 citations
Preference-based reinforcement learning (PbRL) has emerged as a promising paradigm for learning robot behaviors aligned with human intent. However, its scalability is fundamentally limited by the need to collect expensive human preference labels for every new task. In this work, we present PrefO2O, an offline-to-online...
Ruiqi Wang, Dezhong Zhao, Xuesu Xiao et al.· 0 citations
Long horizon agentic tasks are now pushing LLM agents past their context window. To continue the task, the agent scaffold has to free up the context window, a process known as context compaction. Compaction is generally lossy by design: agents can silently lose task constraints, instructions, or their reasoning behind...
Jeanne Salle, Hardik Bhatnagar, Matthias Bethge et al.· 0 citations
The rapid expansions of artificial intelligence (AI), big data (BD), and information and communication technologies (ICT) are driving substantial growth in electricity, water, and material demands, with data centers projected to consume 6.7--12\% of U.S. electricity by 2028 (up from 4.4\% in 2023) and AI-related water...
Jinsong Wu, Yixin Xiao, Haowei Bi et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Chain-of-thought (CoT) monitoring aims to detect potentially harmful behaviors in large language models (LLMs) from their CoTs. Intervention-based evaluations measure this property by asking whether a monitor can detect the role of an intervention from the CoT when the targeted behavior occurs, typically using minimal-...
Qiang Fu, Xinyue Li, Andre Wibisono et al.· 0 citations
Microservice systems have become a dominant architecture for large-scale cloud applications, enabling rapid deployment and elastic scaling. However, ensuring the reliability and availability of microservice systems critically relies on effective anomaly detection, as failures and performance anomalies can quickly propa...
Yixiang Tang, Fagui Liu, Guoxiang Zhong et al.· 0 citations
Differentiable Diffusion Conditioning (D2C) is proposed for offline MBO, which leverages the fact that deterministic sampling makes the reverse denoising chain differentiable with respect to the conditioning signal and turns a frozen conditional diffusion model into an end-to-end gradient-based optimizer.
Ricardo Luna Gutiérrez, Vineet Gundecha, R. Ejaz et al.· 0 citations
Coding agents can be guided with instruction files in a repository. We examine this emerging practice through a census of 22,854 popular, active GitHub repositories in thirteen languages, treating each repository's root'AGENTS$.$md'and'CLAUDE$.$md'as one instruction set. Agent instructions appear in 26.3% of repositori...
Mobile GUI agents frequently perform repetitive tasks with similar interaction procedures. Reusing previous executions can reduce redundant LLM inference and execution overhead, but variations in user instructions and execution environments may invalidate previously successful actions. We systematically characterize th...
Spreadsheets are the lingua franca of modern finance, driving valuation, forecast, audit, and many other core workflows of the industry. As LLM agents advance to automate knowledge work, spreadsheet construction is a natural and pertinent testbed. However, most existing spreadsheet benchmarks evaluate agents on fill-in...
Julian Poeltl, Thomson Yen, Patrick Shea et al.· 0 citations
Context compaction lets long-horizon coding agents continue beyond their context windows, but can erase the state needed to finish a task. Prior evaluations measure efficiency, retained information, or end-to-end success, leaving the effect of a specific history replacement difficult to isolate. Compact-Bench pairs ful...
Ruopei Sun, Jianfeng Cai, Kangwen Zhao et al.· 0 citations
Designing large language model (LLM) multi-agent systems (MAS) still relies on trial and error and informal"folk wisdom."Manual studies test only a few communication structures or topologies (e.g., sequential, parallel, shared-memory, or debate), while automated optimizers discard search trajectories after selecting a...
Xavier F. Cadet, Jun-Yan Cheng, Peter Chin et al.· 0 citations