Skip to content
Conference

Keeping Engineers in the Loop: Explainable Requirement Defect Screening Across Software Requirements Specifications

Aug 2026 · 2026 IEEE 34th International Requirements Engineering Conference Workshops (REW) · pp. 222-226 · 0 citations · 14 references
Computer Science

Abstract

Requirements written in natural language frequently contain ambiguity, incompleteness, and statements that are difficult to validate consistently. This experience report presents a human-centered requirement-validation workflow built around a heterogeneous source corpus of 79 software requirements specification documents. The workflow extracted 9,165 requirement-like statements from this corpus and curated a manually reviewed, single-reviewer adjudicated gold set of 110 requirements, which is the basis for all reported evaluation results. Three screening conditions were compared on this gold set: the original seed heuristic, a flat rule-based screen, and an explainable precedence-based screen that returns a defect label, rationale, source span, rewrite guidance, and confidence. The seed heuristic achieved 0.573 accuracy and 0.499 macro-F1, the flat rule screen achieved 0.500 accuracy and 0.478 macro-F1, and the explainable screen achieved 0.855 accuracy and 0.891 macro-F1. The main finding is that explanation-oriented screening substantially improves practical review support in this corpus, while the remaining errors are dominated by formatting artifacts, truncated list boundaries, and contextual judgments that still require human reviewers. The contribution is not autonomous requirement assessment; it is an auditable human-in-the-loop workflow for prioritizing requirement-quality review.

View source

Similar papers

Conference Sep 2026

Large Language Model Framework for Automated Software Requirement Specification Generation

Requirements engineering faces significant bottlenecks in maintaining explicit traceability between high-level organizational goals and technical system specifications. This study presents an automated requirement generation framework that bridges Organization Goal-Oriented Requirements Engineering and Data-Driven Requ...

Fransiskus Adikara, Sandfreni Sandfreni, Devi Yurisca et al. · 0 citations
Book Open access Oct 2026

Manifesting Implicit Dependencies in Requirements Task: An Automated Method Integrating Code Awareness and Change Analysis

In modern software development, accurately assessing the impact scope of requirement changes is crucial for software quality, yet this task faces two major challenges. First, highly simplified requirement descriptions (one-sentence requirements) tend to conceal complex business logic and extensive system dependencies....

Hui Ma, Jia-Jun Yang, Yan Chen et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Don't Guess, Just Ask: Evaluating Interactive Requirement Clarification for Repository-Level Software Development

As LLMs become increasingly capable of implementing software, a critical bottleneck emerges: whether they truly understand what users want. Users often begin with vague intent, leaving important requirements to be clarified through interaction. In repository-level development, misunderstandings can propagate and cause...

Ming-Yu Chen, Zhiqing Zhong, Man-Yi Wang et al. · 0 citations
#software testing Book Open access Oct 2026

Curated Semantic Mutants: Multi-purpose Artifacts for Grading and Hinting Student Test Suites

A human-LLM workflow that pairs each curated semantic mutant with an instructor-approved seed phrase for an on-demand LLM expansion, which shows that the curated semantic-mutant set contains a fraction of the mutants a traditional mutation engine produces.

Rebecca Williams Earle, Jonathan Bell · 1 citation

On the Impact of Requirement Smells in LLM-Based Code Generation

The results suggest that increasing \textit{smell density} was generally associated with lower test-suite-based functional correctness, although non-smelly requirements could still produce faulty code, and motivates further investigation into task-dependent quality effects in LLM-assisted software engineering.

Hugo Villamizar, Jannik Fischbach, Mert Şahin et al. · 0 citations
Open access Oct 2026

Leveraging Large Language Model for Ambiguity Detection and Resolution in Software Requirement Specifications

A framework that leverages fine‐tuned large language models (LLMs) to systematically detect and resolve ambiguities in software requirements and improves the clarity and usability of requirements and can support more effective communication among software development stakeholders is introduced.

Ankit Raj, M. A. B. Ur Rahim, Mayur Jain et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.