Development and Usability Evaluation of an Intelligent Quiz Repository with AI-based Duplication and Similarity Detection for Instructional Support

Abstract

This study presents the development and usability evaluation of an intelligent quiz repository system enhanced with an Artificial Intelligence (AI)-based duplication and similarity detection mechanism to support quiz creation and management in higher education. The administration of quizzes and the management of item banks will be positively affected by the system in higher education. The whole idea is to create an integrated platform for the instructors to keep their quiz items in an easy way: store, classify and generate. The system’s major constituents are a quiz repository, a quiz generator, a dashboard that contains analytics, and an AI that has a cosine similarity method for tracking duplications and discovering repeating or almost identical questions. The study followed a developmental-descriptive path, concentrating on system architecture, user-interface design, and iterative refinements based on faculty input. The usability principles derived from Nielsen’s heuristics and Software Usability Measurement Inventory (SUMI) were incorporated into the design to ensure clarity, uniformity, and user-friendliness. The findings reveal that the system’s design has effectively addressed the issues of redundancy, disorganization, and manual workload, thus paving the way for new and expanded usability testing of the system in the near future.