Skip to content

The pitfalls of AI detection in academic writing: bias, false positives, and the need for inclusive assessment

Sep 2026 · AI and Ethics · Vol 6 · 0 citations · 50 references
Computer Science

TL;DR

The paper distinguishes genuine false positives from definitional boundary cases involving AI-assisted translation and polishing, engages the counter-argument that AI-polished prose may itself flatten linguistic diversity in academic English, and proposes a concrete process-oriented assessment model based on declared starting points, versioned drafting, process artefacts, and targeted oral verification.

Abstract

AI-text detectors are increasingly used to police authorship in student assessment and scholarly publishing. This paper argues that they are the wrong instrument for that task. Its design combines a critical synthesis of empirical, information-theoretic, and policy evidence with an original documented exploratory multi-tool audit. The review synthesises empirical evaluations, information-theoretic results, and institutional policy decisions to develop a conceptual account of what detectors can directly observe: statistical or learned properties of submitted text, not provenance itself. Predictability-related properties such as low perplexity, reduced variation in local predictability, and formulaic density provide one mechanism through which both additional-language writing and highly conventional academic prose may become vulnerable to machine-authorship classification. While a growing number of universities across several national higher-education systems have disabled or restricted AI detection in high-stakes assessment, and a New York court has annulled a misconduct finding that rested on a detector score, detector reliance persists in three under-examined arenas: individual grading practice at scale, scholarly journal screening, and institutions without formal policy revision. The paper adds a documented exploratory multi-tool audit in which a single human-authored manuscript, submitted to five commercial detectors on the same day, received materially different classifications spanning from “0% human” to “Human Generated”, demonstrating substantial cross-tool inconsistency and limited independent verifiability of the underlying classifications. A paired exploratory comparison further found that extensive machine rewriting by a commercial “humanizer” materially degraded the manuscript while producing only a small change in the reported detection score. The paper distinguishes genuine false positives from definitional boundary cases involving AI-assisted translation and polishing, engages the counter-argument that AI-polished prose may itself flatten linguistic diversity in academic English, and proposes a concrete process-oriented assessment model based on declared starting points, versioned drafting, process artefacts, and targeted oral verification. The model predates generative AI in its component practices but acquires renewed relevance because final-text classification cannot establish authorship, understanding, or misconduct on its own.

Read PDF

Similar papers

Open access Aug 2026

The hidden cost of plagiarism and artificial intelligence detection tools in academic writing

It is argued that human interpretation should remain central to the evaluation of originality, authorship, and research quality and that similarity-detection and AI-detection systems should be viewed as screening indicators rather than definitive judgments.

Deep Shah · 0 citations
Preprint Aug 2026

Style as a Confound: False Positives in AI Detection of Non-Native Academic Writing

The findings identify professional editing style as a key confounding variable in AI detector outputs, rather than establishing a full separation of text origin from linguistic style, raising concerns about fairness and reliability in academic settings.

Hyeonchu Park, Gahye Jeong, Bugeun Kim · 1 citation · ⚡1
Open access Aug 2026

Misclassification of text in Ai detection: A serious limitation of Ai detectors and Its threats to human-based scholarly writing

This editorial highlights the urgent need for human centric approach to AI detection, advocating for strategies that prioritise human-AI collaboration over sole reliance on fallible automated systems.

Noureen Durrani, Yusra Nasir, Sobia Ali · 0 citations
Open access Sep 2026

LLM-assisted writing and citation advantage: evidence from scientific publications before and after ChatGPT release

Analysis of a large-scale dataset covering 234,073 research papers published between 2019 and 2025 suggests that AI-assisted writing confers a modest but systematic advantage in visibility and discoverability that translates into higher measured impact.

S. Paklina, P. Parshakov, Elena Rapoport · 0 citations
Open access Sep 2026

The Readability of Generative AI Policies: An Empirical Analysis of OpenAI’s Informational Documents

In recent years, media attention has focused on artificial intelligence, particularly on chatbot services and generative intelligence. ChatGPT, created by OpenAI, was one of the earliest online tools and rapidly gained popularity. Users are indeed exposed to a service with privacy notifications and conditions of use th...

Jacopo Bassetta, D. Perpetuini, M. Giusti et al. · 0 citations

Related blog posts

Google DeepMind Blog Nov 18, 2026

Genie 4 is now available

We are rolling out a new Project Genie experience to eligible Google AI Ultra subscribers, opening access to our new Genie 4 world model.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.