Skip to content
#software testing Review Open access

Empirical insights on the use of large language models in software verification and validation: evidence from the Brazilian IT industry

Nov 2026 · Empirical Software Engineering · Vol 32 · 0 citations · 39 references

TL;DR

An exploratory empirical view of how AI and LLMs are being selectively incorporated into industrial V&V activities in Brazil is offered and may inform discussions on responsible AI adoption in software engineering and provide preliminary, practitioner-informed insights for future research and governance-oriented decision-making.

Abstract

Artificial Intelligence (AI) has created new possibilities for improving Verification and Validation (V&V) activities in software engineering. Among recent advances, Large Language Models (LLMs) have gained attention for their potential to automate tasks such as test generation, defect detection, and requirements analysis. Although interest in these technologies has increased, their use in industrial environments is still limited and not well understood. Concerns remain about their reliability, transparency, and ethical implications, especially when applied in safety-critical or regulated domains. This paper reports an exploratory empirical study based on a survey with 39 software professionals from different sectors and company sizes in Brazil. The questionnaire investigates the reported use of conventional V&V tools, AI-based testing solutions, and LLM-supported practices, as well as perceptions of effectiveness, workflow integration, cost, and governance challenges. Respondents reported perceived benefits, such as support for automation, test-case creation, code understanding, and efficiency-oriented tasks, along with difficulties related to integration, transparency, reliability, hallucinations, over-reliance, data misuse, and governance. By documenting current practices, perceptions, and expectations, this study offers an exploratory empirical view of how AI and LLMs are being selectively incorporated into industrial V&V activities in Brazil. The findings may inform discussions on responsible AI adoption in software engineering and provide preliminary, practitioner-informed insights for future research and governance-oriented decision-making. Given the exploratory design, convenience sample, and self-reported data, these findings should be interpreted as indicative perceptions rather than statistically generalizable evidence.

Read PDF

Similar papers

Conference Open access 2026

Application of large language models in requirements engineering

Requirements engineering plays a significant role in software development, while the development of large language models (LLMs) provides new opportunities to support and automate various activities within this process. The aim of this paper is to analyze the application of LLMs in requirements engineering, with partic...

Branislava Radu, Ljubica Kazi, I. Berković et al. · 0 citations
#software testing Review Open access Oct 2026

Software Quality and Testing Through Intelligent Automation: A Systematic Literature Review of Applied Artificial Intelligence Techniques

The integration of artificial intelligence (AI) into software testing has emerged as a key mechanism for optimizing code quality and reducing quality assurance costs; however, the proliferation of algorithms and the heterogeneity of their applications hinder the informed selection of techniques and the consolidation of...

Cristian Leonardo Alape Avila, Alejandro Paolo Daza Corredor, Daniel David Leal Lara · 0 citations
Review Open access Oct 2026

LLMs for Model-driven Engineering: A Systematic Literature Review

Model-Driven Engineering (MDE) supports the development of large-scale, complex systems through abstraction, automation, and traceability. The rise of Large Language Models (LLMs) has renewed interest in reshaping MDE, with recent studies exploring their use in tasks such as model generation, model comprehension, as we...

Man Zhang, Yun-Yan Li, Tao Yue · 0 citations
Review Open access Sep 2026

Reflections on the Impact Brought by Large Language Models to Software Engineering Maintenance Modes Under the Wave of Artificial Intelligence

Software maintenance occurs throughout the life cycle of the system and is relatively expensive. The Introduction of large language models is changing how software maintenance is conducted. The five areas this paper investigates for the practical applications of large language models in software maintenance are: mainte...

Wen-Qiang Zhang · 0 citations
Sep 2026

Automated LLM-based Classification of Software Requirements

The adoption of large language models (LLMs) in software engineering has enabled the potential to automate complex activities such as requirements analysis. This paper presents an empirical performance analysis of four modern LLMs: GPT-4o, Aya, Gemma and Phi-4 on the task of automated classification of atomic software...

Nourchène Elleuch Ben Ayed, Jaber Jemai, Keletso J. Letsholo et al. · 0 citations
#software testing Review Open access Oct 2026

Automated Testing and Its Impact on Software Development Quality and Maintainability: A Focused Structured Review

A transition from code-level defect metrics toward process- and system-level maintainability concerns is highlighted, and five research gaps are identified: separating testing practice from testing metrics, context-aware empirical design, standardized measurement and reporting, longitudinal maintainability tracking, an...

Kashodhan Prinkal, S. Degadwala · 0 citations

Related blog posts

Microsoft Research Blog Nov 12, 2026

Microsoft Research Focus – Edition #98

What's new in research at Microsoft? Host Anson Ho explores the latest, including AI-powered universal translation, a breakthrough in a 31-year-old mathematics challenge, and advances making AI coding agents faster and more efficient.  The post Microsoft Research Focus – Edition #98 appeared first on Microsoft Research.

Microsoft Research Blog Nov 5, 2026

Formally verifying agent-written full-stack web apps with PDD Kit

AI agents can generate code at a scale that’s hard for humans to review line-by-line. PDD Kit helps ensure the code is doing what the developer intended by creating formal specifications and testing against them. It converts developer intent into a Verus specification, proves AI-generated code meets it for every input, and uses tests where proofs aren't practical. Developers review intent, not every line. The post Formally verifying agent-written full-stack web apps with PDD Kit appeared first o…

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.