2026· Journal of the Association of Greek Chemists· Vol 3, pp. 72-79· 0 citations
TL;DR
A twelve-criterion framework for structured manuscript assessment and a human-supervised workflow in which AI supports screening and the identification of potential problems, while expert reviewers and editors retain responsibility for evaluating scientific significance, interpreting disputed findings and making publication decisions is proposed.
Abstract
Peer review is central to scientific quality assurance, yet it faces persistent challenges, including reviewer workload, delays, variability in assessment and potential bias. Artificial intelligence (AI), particularly large language models, may support selected aspects of manuscript evaluation, but its reliability, limitations and appropriate role in editorial decision-making require careful consideration. This Perspectives article examines the potential of AI-assisted peer review, drawing on preliminary observations from an exploratory exercise in which two independent AI systems evaluated a number of scientific manuscripts. Both systems identified potential weaknesses in methodological reporting, data presentation and statistical analysis, while also offering differing emphases on clarity, interpretation and context. Because the exercise was not benchmarked against expert human reviewers and did not use a formal quantitative evaluation protocol, these observations are illustrative rather than evidence of validated reviewing performance. Building on these observations, we propose a twelve-criterion framework for structured manuscript assessment and a human-supervised workflow in which AI supports screening and the identification of potential problems, while expert reviewers and editors retain responsibility for evaluating scientific significance, interpreting disputed findings and making publication decisions. The framework emphasizes independent verification, confidentiality, transparency and accountability. Blinded, controlled studies are needed to establish the accuracy, consistency, fairness and practical value of AI-assisted review. Responsible integration should therefore be guided by empirical validation rather than assumptions that AI is inherently objective or that faster generation of a review necessarily improves the publication process.
Artificial intelligence (AI) in scholarly peer review has the potential to simplify the work of editors and reviewers through faster triage, automated reporting completeness checks, and scalable synthesis of reviewer comments. However, it also presents practical, ethical, and technical limitations that may place implem...
A. Babker· Frontiers in Artificial Inte...· 1 citation
Peer review is important in maintaining the quality of scholarly publishing, but the process faces challenges such as shortage of reviewers, delays, inconsistent judgements, and overlooked errors. These challenges have increased the need to consider the appropriate use of artificial intelligence (AI) in peer review. Co...
V. J. Owan, M. V. Owan, Eyo Etim Akpandem· Educational Point· 0 citations
This talk presents case studies in which evaluation metrics reward surface-level improvements like polish and fluency while overlooking evidentiary content, correctness, and editorial usefulness, and discusses practical lessons for building reliable evaluation systems in real peer review workflows.
Negar Arabzadeh, Sajad Ebrahimi, Shakiba Amirshahi et al.· Proceedings of the 35th ACM...· 0 citations
The number of papers published in health promotion journals has grown substantially for two decades, and mainstream use of generative artificial intelligence (AI) has accelerated that growth. Yet peer review remains fundamentally unchanged. Review still depends on volunteer time, and many journals prohibit reviewers fr...
M. Patterson, Jason E. Maddock· American Journal of Health P...· 0 citations
As generative AI becomes embedded in academic publishing, questions of efficiency and accuracy also raise questions about the authority of scholarly evaluation. Through normative and institutional analysis and a prospective thought experiment, this article distinguishes peer review from protocol review. Peer review use...
Xu-Feng Zhang, Han Li· Research Ethics· 0 citations
Artificial intelligence (AI) is rapidly transforming radiology research and is progressively influencing the scholarly publication process itself. Large language models (LLMs) are being increasingly used for manuscript writing. At the other end of the spectrum, AI can assist with manuscript screening, statistical and m...
P. Patel, Akshay D. Baheti, Puneet Bhargava et al.· Current problems in diagnost...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.