Skip to content

Generating Edit-Inducing Questions for AI Research Manuscripts

Sep 2026 · 0 citations · 12 references
Computer Science

TL;DR

This work studies the ability of LLMs to generate edit-inducing questions whose answer will improve a paper draft and compares the helpfulness of questions from GPT models with or without full paper context to that of human reviewers.

Abstract

We study the ability of LLMs to generate edit-inducing questions whose answer will improve a paper draft. On a dataset of paired submission and camera-ready papers from ICLR and NeurIPS, we compare the helpfulness of questions from GPT models with or without full paper context to that of human reviewers. GPT produces more edit-inducing questions and its questions are associated with more extensive edits and cover a broader range of edited content compared to questions from reviewers. However, a much smaller percentage of the GPT questions are edit-inducing. Our analyses confirm that automated questions can be beneficial to authors and highlight an example task where proper attending to long context deteriorates reasoning model ability to produce helpful output.

View source

Similar papers

Preprint Oct 2026

Can This LLM Annotate My Data? Estimating Zero-Shot LLM Performance

It is found that it is possible to predict LLM performance - to a certain degree - and that contrary to other work which highlights the usefulness of LLM verbalizations of self-confidence, internal log-probabilities are the most predictive signal.

Tong Lin, Grant Schoenebeck, Sabina Tomkins · 0 citations

ReGround: Grounding Reviewer Comments in Multimodal Evidence

ReGround is introduced, a large-scale dataset for reviewer comment grounding that links 10,267 reviewer comments to 16,274 evidence in the original anonymous submission of 3,656 papers and exposes grounding reviewer comments as a difficult and practically important problem for scientific document understanding.

Serwar Basch, Li-Zhen Qu, Iryna Gurevych · 0 citations

Document Summarization for AI-based Post-Editing

It is suggested that summary specificity and actionability, rather than the mere addition of context, determine whether document-level information benefits post-editing.

Vera Senderowicz Guerra, Dimitrios Pavlou, Peter Bourgonje · 0 citations
#artificial intelligence Conference Open access Oct 2026

From Prompts to Trees: Effective LLM-Guided Tree Generation for Few-Shot Tabular Classification

While Large Language Models (LLMs) possess rich world knowledge and impressive generalization capabilities, their direct application to tabular data classification is hindered by high inference costs and limited interpretability. In contrast, decision trees are fast and transparent but often underperform in low-data re...

Yue Qiu, Ze-Kang Du, Yi-Qun Diao et al. · 0 citations

Related blog posts

Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.