ULSTM: Multi-Scale and Full-Level Temporal Consistency for Traffic Anomaly Detection

Abstract

Urban traffic anomaly detection is essential for intelligent transportation systems, particularly in smart city environments where fast identification of abnormal events can improve road safety and traffic management. This work proposes a novel ULSTM-driven architecture that explicitly models temporal dependencies across consecutive traffic frames to achieve more stable and temporally coherent reconstructions. The proposed framework leverages sequential spatio-temporal representations to improve the distinction between normal traffic patterns and anomalous events. To further enhance reliability, we introduce a Hybrid Weighted Fusion strategy that synergistically combines structural, perceptual and pixel-wise metrics. The framework’s parameters are optimized using a Discrete Dirichlet Sampling approach, achieving a peak F1 Score of 70.28%. Evaluations were conducted on a manually curated traffic anomaly dataset with frame-level annotations. Experimental results demonstrate that the ULSTM framework significantly outperforms frame-independent generative models by suppressing high-frequency reconstruction noise, providing a robust solution for real-world smart city deployments. While highly effective in complex scenarios, the proposed framework is strictly applicable to highly dynamic traffic environments with active motion, as static background ensembles can degrade performance.