An attention-enhanced CNN integrated with Explainable Artificial Intelligence (XAI) to achieve reliable and interpretable driver behavior classification is proposed and can be applied in real-time driver monitoring applications.
Abstract
Driver behavior detection is essential for improving road safety in Intelligent Transportation Systems (ITSs). This paper proposes an attention-enhanced CNN integrated with Explainable Artificial Intelligence (XAI) to achieve reliable and interpretable driver behavior classification. Furthermore, the model also uses a multi-head attention mechanism to ensure that it captures local spatial features as well as long-range dependencies in the activities of the driver. The State Farm Distracted Driver dataset is experimented with using stratified 5-fold cross-validation. The proposed MHA-CNN model has a mean accuracy of 99.48% on all folds and an overall high levels of precision, recall, and F1-score in all ten distraction classes. Grad-CAM is used to produce attribution maps to improve interpretability by showing semantically important parts of the image, including hands, face, and mobile devices, and can give a visual explanation of why models make decisions. In addition, an ablation investigation is performed with k-fold validation to assess the value of the multi-head attention mechanism. Its model can run at 122 frames per second with 42.92 million parameters, showing that the suggested method is a reasonable tradeoff between accuracy, efficiency, and transparency and can be applied in real-time driver monitoring applications.
The fast development of intelligent surveillance systems has enhanced the need to have intelligent and dependable analysis of human behaviour through computer vision methods. To overcome these obstacles, this paper presents an AI-enabled platform for analyzing human behavior in intelligent surveillance settings with th...
Anshu Vashisth, Gagandeep Kaur, Neha et al.· International Conference on...· 0 citations
The proposed framework provides an efficient and robust solution for nighttime pedestrian detection and can be integrated into advanced driver assistance systems and autonomous vehicles to improve road safety under low-visibility conditions.
Mohammod Asma Thahniyath, Sk.Mahammadunnisa· International Journal of Dat...· 0 citations
The proposed framework comprises sensor fusion, image processing, feature extraction, deep neural network inference and explainability mechanisms such as Gradient-weighted Class Activation Mapping, Local Interpretable Model-Agnostic Explanations and SHapley Additive exPlanations.
Johan Håstad's mentor Arne Andersson, Börje Langefors· International Journal of Eme...· 0 citations
This study presents a methodology to identify driver’s distraction using a refined You Only Look Once (YOLO) model, denoted as YOLOv11, which demonstrates higher accuracy and robustness, making it suitable for real-world driver monitoring system (DMS) deployments.
Bao Ma, Hamid Taghavifar, Zhi-Jun Fu et al.· SAE technical paper series· 0 citations
A hybrid deep learning (DL) model that integrates Coordinate Attention (CA), Convolutional Neural Networks (CNN), and Transformer encoders for better HAR achieves superior performance and proved its effectiveness for workplace safety monitoring applications.
E. Jyotsna, T. Jarin· Neural computing & applicati...· 0 citations
The development of autonomous vehicles (AVs) usually relies heavily on data-driven artificial intelligence (AI) models that require large volumes of sensor data with ground-truth annotations. While modular architectures are widely used, end-to-end driving paradigms offer a promising alternative by directly mapping sens...
A. Contreras, Diego Porres, R. Abad et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.