Skip to content

Author

Roi Pony

We have 4 of 15 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Oct 2026

LLM Evolutionary Search Strategies Should be Compared by Tokens

LLM evolutionary search is currently evaluated by counting proposals (candidate programs). We demonstrate this metric hides the true cost of search, and redo the comparison using tokens. By replaying 600 logged runs across 5 tasks and 3 methods, we show that proposal costs vary wildly from 16k to 39k tokens. In equal-p...

Tal Oved, Roi Pony, Oshri Naparstek et al. · 1 citation
Review Sep 2026

Spotlights: Discovering Improvement Opportunities in Software Repositories

Spotlights is presented, a system that performs optimization-opportunity discovery as a distinct and empirically evaluable step between a broad engineering objective and subsequent implementation and validation.

U. Barzelay, Ophir Azulai, Idan Friedman et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Evolution or Illusion? Rethinking Evaluation in LLM Evolutionary Search

This work evaluates three evolutionary search strategies on five optimization tasks, commonly used by papers in the genre to report results, and suggests that the best way to split a fixed budget between more seeds and more iterations changes with the strategy, the task, and the total budget.

Tal Oved, Roi Pony, O. Naparstek et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.