Evaluating Interactive Assessment Features of an Web-Based Learning System Using UEQ

Abstract

Object-Oriented Programming (OOP) is one of the most conceptually demanding subjects in vocational software engineering education. However, students are usually assessed with multiple-choice items that test recognition rather than their ability to construct code. Fill-in-the-blank and radio-button formats address this gap in complementary ways. However, their combined use in a single vocational OOP platform has not been evaluated from a user-experience perspective. The purpose of this study is to evaluate the user experience of OOPedia. This web-based OOP learning system integrates both formats and positions the results against the UEQ international benchmark. The study used a two-stage method: OOPedia was first developed using a prototype development methodology, and its user experience was measured using the User Experience Questionnaire (UEQ) across six dimensions. Participants were 32 Software Engineering (SE) students, aged 16–17, taking the OOP course at a vocational high school in Malang, Indonesia, all of whom had used both features beforehand. Dimension means were tested against the neutral midpoint using one-sample t-tests, compared with the UEQ global benchmark, and assessed for reliability using Cronbach's α. The results show that all six dimensions scored significantly above neutral (p < 0.001) and met the benchmark: Stimulation and Attractiveness reached the Excellent band, and the other four reached Good or Above Average. In contrast, novelty showed low reliability (α = 0.52) and was reported with caution. The practical impact is an empirical UX baseline that designers of school e-learning platforms can use when selecting interactive assessment formats, ahead of the controlled learning-outcome study recommended as future work.