This work studies the ability of LLMs to generate edit-inducing questions whose answer will improve a paper draft and compares the helpfulness of questions from GPT models with or without full paper context to that of human reviewers.
Abstract
We study the ability of LLMs to generate edit-inducing questions whose answer will improve a paper draft. On a dataset of paired submission and camera-ready papers from ICLR and NeurIPS, we compare the helpfulness of questions from GPT models with or without full paper context to that of human reviewers. GPT produces more edit-inducing questions and its questions are associated with more extensive edits and cover a broader range of edited content compared to questions from reviewers. However, a much smaller percentage of the GPT questions are edit-inducing. Our analyses confirm that automated questions can be beneficial to authors and highlight an example task where proper attending to long context deteriorates reasoning model ability to produce helpful output.
It is found that it is possible to predict LLM performance - to a certain degree - and that contrary to other work which highlights the usefulness of LLM verbalizations of self-confidence, internal log-probabilities are the most predictive signal.
Tong Lin, Grant Schoenebeck, Sabina Tomkins· 0 citations
ReGround is introduced, a large-scale dataset for reviewer comment grounding that links 10,267 reviewer comments to 16,274 evidence in the original anonymous submission of 3,656 papers and exposes grounding reviewer comments as a difficult and practically important problem for scientific document understanding.
It is suggested that summary specificity and actionability, rather than the mere addition of context, determine whether document-level information benefits post-editing.
Vera Senderowicz Guerra, Dimitrios Pavlou, Peter Bourgonje· 0 citations
While Large Language Models (LLMs) possess rich world knowledge and impressive generalization capabilities, their direct application to tabular data classification is hindered by high inference costs and limited interpretability. In contrast, decision trees are fast and transparent but often underperform in low-data re...
Yue Qiu, Ze-Kang Du, Yi-Qun Diao et al.· Proceedings of the 2026 Conf...· 0 citations
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.