Development and Evaluation of Ansible-Based Cross-Platform Orchestration Learning Media in an EVE-NG Virtual Laboratory

Abstract

This study developed and evaluated Ansible-based cross-platform orchestration instructional media in an EVE-NG virtual laboratory for Computer and Network Engineering students at a vocational high school. The study employed the ADDIE development model, comprising analysis, design, development, implementation, and evaluation. The product was an integrated package consisting of the Network Automation with Ansible e-module, an EVE-NG topology, Linux, Cisco, and Windows inventories, 11 playbooks, and execution, verification, and troubleshooting guides. Content appraisal involved two subject-matter experts (mean ), media appraisal one expert, and practicality appraisal four teachers and 10 students. Preliminary effectiveness was examined in two intact Grade XI classes of 33 students each, one using the developed package and the other using physical laboratory devices. Skill data were collected using a performance test with an analytic scoring rubric administered before and after instruction. Content and media ratings were 91.67% and 94.44%, respectively; teacher and student practicality means were 4.54 and 4.23 on a five-point scale. The experimental class's mean score increased from 50.61 to 70.00, whereas the control class's mean increased from 48.54 to 60.30. Mean N-Gain was 0.396 and 0.226, respectively; an exploratory student-level comparison yielded , , with . Because each condition comprised only one intact class, treatment and class effects could not be separated. The ratings and learning outcomes therefore provide preliminary, context-specific support for using the package as a complement to physical laboratories; replication across multiple classes is required.