Skip to content

Category

software testing

2,999 papers

#software testing Book Open access Oct 2026

The Gene Is Not the Gate: Conceptualizing the Semantic Genome of Quantum Software

This work presents QGenome, a semantic foundation for quantum software genomics that establishes a falsifiable framework and a concrete research agenda for gene mining, lineage recovery, cross-layer regression testing and repair, and evidence-grounded quantum software agents.

Jiongchi Yu, Yue Duan, Zi-Ming Zhao et al. · 0 citations
#software testing Book Open access Oct 2026

Automated Annotation of Test Types using LLMs: A Multi-LLM Workflow for Machine Learning Test-Related Commits

This analysis focused on their classification performance, stability, agreement with experts, top-2 candidate recovery, and multi-LLM voting workflows (S1-S4) along with a corresponding analysis on Keras.

Asli Sari, Ayse Tosun, G. Alptekin · 0 citations
#software testing Book Open access Oct 2026

Prompt Pipelines as Engineered Artifacts: Regression-Testing a Multi-agent Threat-Modeling Pipeline

The experience suggests that the PromptOps practices recently proposed for general LLM applications transfer directly to security engineering, and that a fixed evaluation corpus with cost-aware metrics is the single most valuable artifact a prompt-pipeline team can maintain.

Eldar Mametov, Andrey Sadovykh, Eugene Zouev et al. · 0 citations
#software testing Book Open access Oct 2026

Using LLM Agents for Security Testing of Compiled Mobile Applications: A Case Study on a Real-World Compiled iOS App

It is concluded that developers should use LLMs at the source-code level to counter adversaries applying the same techniques on decompiled code and research should advance decompilation support for the growing language diversity in the iOS ecosystem.

Fabian Scherf, Florian Magin · 0 citations
#software testing Book Open access Oct 2026

Same Task, Different Fate: Population Structure in Trajectory-Based Analyses of Coding Agents

Coding-agent trajectories are read as evidence about the software process, and analyses pool runs from many different tasks. The task predicts both the behaviour and the outcome, so a pooled estimate mixes a within-task and a between-task channel, and is read as a statement about runs. We quantify that mixing with the...

Simarjot Khanna · 0 citations
#software testing Book Open access Oct 2026

FitGen: Validation and Guided Repair of LLM Generated Executable Fitness Functions for Search Based Software Testing

FitGen is presented, a validation guided repair framework combining structured prompt design with output, syntax, and semantic validation to automatically diagnose and repair executable fitness functions.

Md Al Muzahid Nayim, Faezeh Rajabi Kouchi, Amit Kumar Sikder et al. · 0 citations
#software testing Book Open access Oct 2026

Whose Specification Did You Test? The Hidden Interpretation Bias in LLM-Generated Test Suites

This work examines three test-generation strategies that vary in coverage and emphasis on ambiguous behaviours and discusses the implications for autonomous software engineering pipelines in which a single model generates both code and tests from the same specification.

Md Mainul Islam · 0 citations
#software testing Book Open access Oct 2026

Does Architecture Matter? Comparing Multi-agent Workflows for Filtering and Prioritizing Static Analysis Findings

The number of exploited software vulnerabilities rises every year, and their impact grows as software systems become ever more interconnected. To detect such vulnerabilities in large codebases, many organizations rely on Static Application Security Testing (SAST) tools. However, SAST tools can produce high volumes of f...

Linus Bennin, Oshando Johnson, Eric Bodden · 0 citations
#software testing Book Open access Oct 2026

The Driver Was Never the Problem: Cross-Platform Test Portability as a Semantic Contract

Under this model, generative components ground test intent at authoring time into reviewable artifacts, rather than re-evaluating locators during every test run, and semantic agreement is achievable but not automatic: nine of twenty guarantee-surface pairs resolve.

Simarjot Khanna · 0 citations
#software testing Book Open access Oct 2026

Closed-World Trustworthy Copilots for Legal and Regulatory Text

Applying large language models (LLMs) to regulated domains such as financial and legal compliance is fundamentally a software engineering problem: an answer produced from a model’s parameters is, at the surface, indistinguishable from one grounded in the authoritative source, yet only the latter can be audited. Prior s...

Monalisha Ojha, P. Mishra · 0 citations
#software testing Book Open access Oct 2026

Agentic Software Porting: Lessons from the CHERI-PIT

Eight lessons from six months of developing CHERI-PIT, an LLM-agent pipeline that ports C/C++ projects to the memory-safe pure-capability (purecap) ABI of CHERI hardware on Arm Morello, trace a path toward a porting tool that emits reproducible and auditable port recipes.

Noam Benkler, Steven Johnston, D. Lide et al. · 0 citations
#software testing Book Open access Oct 2026

Passing Parity Is Not Preserving Behaviour: Oracle Escape in Function-Level LLM Code Migration

Parity testing validates software modernization: the legacy system supplies every expected output, so the oracle is sound. One decision is delegated, increasingly to a language model and often the very model that translated the code: which inputs to try. How much divergence such suites let through is unmeasured, and wh...

Simarjot Khanna · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 2, 2026

Documenting the tech worker movement

Writing as a participant and researcher, PhD student JS Tan SM ’22 has co-authored a new book about the rise of tech worker protests and the employer backlash that followed.

MIT News · Artificial Intelligence Oct 2, 2026

Documenting the tech worker movement

Writing as a participant and researcher, PhD student JS Tan SM ’22 has co-authored a new book about the rise of tech worker protests and the employer backlash that followed.

GPT-Lab Sep 23, 2026

Requirements Don’t Live in Isolation: What We’re Exploring with Req-Space

Requirements in large systems rarely exist in isolation. Their meaning depends on the wider project context - other requirements, policies, decisions, tests, and implementation details. That becomes especially important when AI is used for review, because spotting a possible conflict or gap is only the beginning. ReqSpace explores how AI, visualisation, and connected project context can help reviewers understand those findings, trace the relationships behind them, and focus on the questions that…

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.