Research taste, the judgment of what to read, which problems to pursue, and which methods to try, increasingly shapes the work of AI scientists, yet it remains far less understood than their ability to execute research. We introduce IdeaTaste, a benchmark that scores an LLM by how closely the research proposals it writ...
Shan Zhong, Chen-Xuan Xu, Jing-Jie Ning et al.· 0 citations
Generative artificial intelligence (AI) models can perform increasingly complex tasks, yet greater AI usage does not necessarily translate into proportional productivity gains. We identify token-max as one source of this inefficiency: when token consumption is treated as productive effort, agents are encouraged to over...
Chen-Xi Xu, Meng-Qiao Liu, Bei-Bei Li et al.· 0 citations
The sandbox provides a search API that indexes large-scale public web corpora, namely ClueWeb22 and FineWeb, using a state-of-the-art dense retriever and approximate nearest neighbor search via DiskANN and achieves comparable latency to popular commercial APIs while ensuring stable document rankings across runs.
João Coelho, Jingjie Ning, Jingyuan He et al.· International Conference on...· 3 citations
A platform--creator mechanism called VCR based on verifiable-content rewards, which credits rewrites that surface checkable factual substance, aligning creator incentives with answer trustworthiness and produces a win--win outcome under the empirical equivalence criterion.