Skip to content
Book Open access

Prompt Engineering in Software Engineering Education: An Empirical Study of Demand, Supply, and Assessment

Jul 2026 · SIGSOFT FSE Companion · pp. 1165-1176 · 0 citations · 52 references
Computer Science

TL;DR

A large-scale empirical triangulation of industry demand and curricular supply for prompt-engineering competencies in software development provides an empirical foundation to inform curriculum design and assessment in software engineering education amid the rapid diffusion of large language models.

Abstract

Prompt engineering is increasingly embedded in software development practice, yet software engineering curricula lack evidence-grounded guidance on which prompt-related competencies to prioritize and how to assess them. This paper presents a large-scale empirical triangulation of industry demand and curricular supply for prompt-engineering competencies in software development. By analysing prompt-related job advertisements across major economies and auditing course descriptions from leading computer science programs, we identify systematic mismatches between practice-facing expectations and formal educational coverage. Industry demand consistently emphasizes prompt design alongside evaluation and testing, with strong signals for prompt optimization and a substantial subset of postings highlighting retrieval augmentation and orchestration. In contrast, university curricula predominantly foreground prompt creation and refinement, with limited explicit emphasis on systematic evaluation. Building on this triangulated evidence, we distil three recurring gaps and derive assessment-oriented implications, specifying inspectable student artefacts, such as evaluation harnesses, lifecycle documentation, and safety testing evidence, that allow prompt-engineering competence to be evaluated in software engineering terms. Collectively, the study provides an empirical foundation to inform curriculum design and assessment in software engineering education amid the rapid diffusion of large language models.

Read PDF

Similar papers

#software testing Preprint Sep 2026

From Prompting to Engineering: A Research Agenda for Prompt Engineering in Software Engineering

A structured community discussion at the First International Workshop on Empirical Prompt Engineering for Software Engineering (PROMPT-SE) discussed current prompting practices, challenges to their adoption and evaluation, and future directions for integrating prompt engineering into software development.

Vincenzo De Martino, Giovanna Broccia, Fabiano Pecorelli et al. · 0 citations
Review

Prompt engineering applied to code generation: a preliminary systematic review

This Systematic Literature Review examines prompt engineering in automatic code generation using large language models (LLMs) and shows that prompt engineering has been established as a key discipline for optimizing interaction with LLMs and improve the accuracy, robustness, and applicability of the generated code.

E. Camacho, Y. Gutierrez, César Pardo · 0 citations
Review Jul 2026

Structured AI Demonstrations and Student LLM Use in Engineering Mechanics: Study Design and Preliminary Results

This manuscript presents a descriptive study design and preliminary findings from an undergraduate engineering mechanics course conducted in Spring 2026, and details a reproducible survey instrument used to capture student AI usage patterns, attitudes, and verification practices, which are subsequently linked to academ...

S. Geng, Helen Lallos-Harrell, Jiya Ashar et al. · 0 citations
Review Open access Aug 2026

Embedding Engineering Design Across Courses in an Integrated Mechanical Engineering Work-Study Curriculum

This paper presents the redesign of several engineering design learning activities within a new and unique work-integrated mechanical engineering program structured around an extended on-the-job component. Early cohorts highlighted gaps in student preparedness for the large scale, open-ended capstone projects conducted...

Laurent Comier, Marie-Christine Turcotte · 0 citations
Review Open access Aug 2026

From Artifact to Decision Instrument: A Critical Review of Prototyping in Engineering Design

Prototyping has evolved from a simple representational artifact into a central mechanism for learning, communication, risk reduction, and decision-making in engineering design. Despite its widespread adoption across engineering disciplines, existing research remains fragmented across domains, methodologies, and applica...

R. Landaeta, A. Zabihollah, R. Jazar · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.