Quantized vs. Full-Precision YOLO Models on Edge Devices: A Performance Benchmark for Real-Time License Plate Detection in Smart Parking Systems

Abstract

The deployment of deep learning-based vision systems on edge devices introduces a complex trade-off between computational efficiency and detection accuracy. In this work, we investigate this trade-off in the context of a multi-stage Automatic License Plate Recognition (ALPR) pipeline, evaluated in two heterogeneous edge execution environments: a general-purpose Raspberry Pi 5 single-board computer and the ARTPEC-8 system-on-chip integrated into an Axis smart camera, where neural network inference is accelerated by the on-chip DLPU. All experiments were performed using pre-recorded images loaded from the file system; neither the Axis camera sensor nor a live video stream was used. This study evaluates the impact of model architecture, numerical precision, and input resolution on both inference latency and detection performance. YOLOv5- and YOLOv8-based models were analyzed under multiple quantization schemes (FP32, FP16, dynamic, and INT8), while a cross-platform benchmark was conducted to assess the benefits and limitations of hardware acceleration. The results show that dedicated accelerators provide significant latency reduction at higher resolutions; however, this advantage is accompanied by reduced flexibility and increased sensitivity to quantization effects. In contrast, CPU-based execution enables the use of more recent and quantization-robust model architectures, which can partially compensate for the lack of hardware acceleration when combined with resolution scaling. Furthermore, the analysis hig ights the importance of hybrid-resolution processing in multi-stage pipelines, where different stages can operate at different input resolutions to balance accuracy and performance. The findings demonstrate that optimal system design requires a joint consideration of hardware characteristics, model architecture, and quantization strategy, rather than relying on a single optimization dimension. The presented results provide practical insights for the design of efficient and robust edge-based ALPR systems, with direct implications for real-world industrial deployments.