Automated Black-Box and Manual Basis Path Testing on E-OBE Application

Abstract

In the current digital era, the development of academic mobile applications, such as the E-OBE application used by Universitas Trunojoyo Madura, requires rigorous testing to ensure robustness and reliability. However, manual testing is often inefficient for detecting complex backend issues and input-handling weaknesses within modern REST API architectures. Objectives: This study aims to evaluate the structural complexity and external robustness of the E-OBE mobile application's backend using a combined testing approach. Methods: The research utilizes White-Box testing, implementing the basis path technique to manually measure the cyclomatic complexity of selected system controllers. Simultaneously, automated Black-Box testing is executed via EvoMaster, targeting REST API endpoints configured with an OpenAPI schema to generate extensive test cases. Results: The White-Box testing revealed that the cyclomatic complexity of the evaluated controller functions ranges from 1 to 5, indicating a relatively simple control flow within the examined source code. Conversely, the automated Black-Box testing (where the optimal run generated 49 HTTP calls and 47 JUnit tests) detected 27 distinct fault manifestations. These unique faults were predominantly API response schema mismatches (22 occurrences), server errors (HTTP 500) (4 occurrences), and an authentication issue (1 occurrence). Conclusions: The evaluated controller functions of the E-OBE application exhibit simple structural complexity. However, the automated testing revealed significant input-handling weaknesses and schema inconsistencies. The API documentation and external input validation require significant improvements to resolve mismatches and prevent server crashes, ensuring better reliability for future front-end integration.