Jul 2026· Anais do XXXIV Workshop sobre Educação em Computação (WEI 2026)· pp. 98-109· 0 citations· 15 references
TL;DR
A framework for designing autograder test suites where a single programming problem is deconstructed into multiple competencies is introduced, supporting the instructor in designing a test suite aligned with the learning objectives related to the predefined competencies.
Abstract
Automated programming autograders are essential for providing immediate feedback in programming education. However, conventional autograders are often limited to evaluating functional correctness through pass/fail tests. This article introduces a framework for designing autograder test suites where a single programming problem is deconstructed into multiple competencies. To automatically assign a grade to a student’s activity, the tool allows for defining weights for each test case, supporting the instructor in designing a test suite aligned with the learning objectives related to the predefined competencies. An experiment comparing this framework with traditional paper-based evaluations revealed a 97% reduction in grading time (r = 0.70 correlation), while effectively shifting the instructor’s role from grader to assessment designer.
This work analyzed 23 publicly available syllabi and course materials of upper-division, credit-bearing courses that meet specific criteria, including explicitly addressing Generative AI in software engineering, and characterized courses'learning objectives, assessments, topics, and documented AI tools.
Francis Geng, Anshul Shah, Miannuan Chen et al.· 1 citation
A comparative analysis of six LLMs for generating formative feedback on introductory Java programs containing predefined defects under controlled conditions reveals substantial cross-model variation, particularly in multi-defect scenarios.
Melina Najimi, Saba Yazdani, Marzieh Ahmadzadeh· Proceedings of the Canadian...· 0 citations
This paper introduces CodeOwl, an AI-driven tool that automates the generation of tiered Parsons problems automatically, and evaluated CodeOwl with a mixed-method framework comprising complexity analysis, expert ratings, and user studies.
Luca Cisternino, Florian Obermuller, Gordon Fraser· arXiv.org· 0 citations
This study identifies a critical research gap: competency evolution at the senior engineering tier remains substantially under-researched compared to junior and mid-level stages and offers practical implications for software organizations and educational institutions in redesigning competency development pathways in th...
Muhamad Anggun Novembra· Jurnal Serumpun Teknik Infor...· 0 citations
By analyzing 1,383 posts from five research-focused subreddits, it is found that students systematically outsource the cognitive effort required to develop research skills and end up with neither the expected results nor the necessary competence.
Enne Rebeca de Freitas, Gustavo Pinto, Danilo Monteiro· arXiv.org· 0 citations
The design and implementation of a web application that connects to a university version control system, analyzes student-selected repositories, and generates programming challenges targeted at weaknesses identified in the submitted source code is presented.
M. Horváth, Michaela Durkovicová, Lenka Bubenková et al.· International Computer Progr...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
