Skip to content
#generative ai Open access

EFL Students’ Error Detection, Correction, and Acceptance Calibration: A Performance-Based Study at the Faculty of Education–Surman

Oct 2026 · Comprehensive Journal of Science
EFL/ESL Teaching and Learning

Abstract

Generative artificial intelligence (GenAI) is increasingly used in English language learning for writing support, grammar correction, feedback, translation, and academic language production. Its educational value depends not only on students’ ability to use AI tools but also on their ability to evaluate AI output and make appropriately calibrated reliance decisions. This study investigated EFL students’ performance in detecting and correcting linguistic errors in a 30-item English sentence evaluation task and examined the correspondence between their acceptance or rejection decisions and the observed correctness of the items. A quantitative descriptive-correlational design was used with 30 EFL students who evaluated 17 correct sentences and 13 sentences containing targeted errors. For each item, participants judged correctness, provided a correction when necessary, indicated whether they would accept the sentence without further checking, and rated their confidence on a five-point scale. Detection, correction, acceptance calibration, overacceptance, and underacceptance were summarized using means and standard deviations. Spearman’s rank-order correlation was used to examine associations between performance and acceptance calibration. Mean detection performance was 92.22% (SD = 4.23), mean correction performance was 91.28% (SD = 8.01), and mean acceptance calibration was 75.33% (SD = 8.51). Mean overacceptance was 17.18% (SD = 10.24), whereas mean underacceptance was 30.39% (SD = 13.56). No statistically significant association was observed between detection and acceptance calibration (ρ = .056, p = .770) or between correction and acceptance calibration (ρ = .003, p = .987). These findings indicate that accurate linguistic evaluation and calibrated acceptance decisions should not be treated as interchangeable outcomes. Within the limits of the small, non-probability sample and the single task used in this study, the results support the inclusion of explicit verification and critical evaluation activities in EFL instruction.

View source

Similar papers

#artificial intelligence Conference Open access Apr 2020

ECCOLA - a Method for Implementing Ethically Aligned AI Systems

The method, ECCOLA, is presented, which aims at making the high-level AI ethics principles more practical, making it possible for developers to more easily implement them in practice.

Ville Vakkuri, Kai-Kristian Kemell, P. Abrahamsson · 64 citations · ⚡6
#computer vision Review Apr 2024

AI-powered Code Review with LLMs: Early Results

The goal is to not only refine the accuracy of the LLM-based tool but also to underscore its potential in streamlining the software development lifecycle through proactive code improvement and education.

Z. Rasheed, Malik Abdul Sami, Muhammad Waseem et al. · 62 citations · ⚡3
#computer vision Open access Mar 2024

LLM-based agents for automating the enhancement of user story quality: An early report

The use of large language models to automatically improve the user story quality in Austrian Post Group IT agile teams is explored, with a reference model for an Autonomous LLM-based Agent System developed and implemented at the company.

Zheying Zhang, M. Rayhan, Tomas Herda et al. · 48 citations · ⚡4
#computer vision Review Mar 2024

System for systematic literature review using multiple AI agents: Concept and an empirical evaluation

This paper introduces a novel multi-AI-agent system designed to fully automate SLRs, and demonstrates how it substantially reduces the time and effort traditionally required for SLRs while maintaining comprehensiveness and precision.

Abdul Malik Sami, Z. Rasheed, Kai-Kristian Kemell et al. · 44 citations · ⚡2
#computer vision Feb 2024

Can Large Language Models Serve as Data Analysts? A Multi-Agent Assisted Approach for Qualitative Data Analysis

The proposed LLM-based multi-agent system automates qualitative data analysis process, creating opportunities for researchers and practitioners, and future improvements focus on enhancing multilingual performance and integrating continuous expert feedback.

Z. Rasheed, Muhammad Waseem, Aakash Ahmad et al. · 41 citations

Related blog posts

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

GPT-Lab Oct 14, 2026

Building trustworthy AI: The role of AI harnesses, intent contracts and evals

AI is moving beyond impressive demos. After World Summit AI 2026 in Amsterdam, GPT-Lab's Muhammad Waseem reflects on what organizations need to make AI agents reliable, responsible and genuinely useful in everyday work. The post Building trustworthy AI: The role of AI harnesses, intent contracts and evals appeared first on GPT-Lab.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.