Skip to content
Open access

An Attention-Enhanced CNN with Explainable AI for Driver Behavior Detection in Intelligent Transportation Systems

Jul 2026 · Algorithms · Vol 19, pp. 615 · 0 citations · 35 references

TL;DR

An attention-enhanced CNN integrated with Explainable Artificial Intelligence (XAI) to achieve reliable and interpretable driver behavior classification is proposed and can be applied in real-time driver monitoring applications.

Abstract

Driver behavior detection is essential for improving road safety in Intelligent Transportation Systems (ITSs). This paper proposes an attention-enhanced CNN integrated with Explainable Artificial Intelligence (XAI) to achieve reliable and interpretable driver behavior classification. Furthermore, the model also uses a multi-head attention mechanism to ensure that it captures local spatial features as well as long-range dependencies in the activities of the driver. The State Farm Distracted Driver dataset is experimented with using stratified 5-fold cross-validation. The proposed MHA-CNN model has a mean accuracy of 99.48% on all folds and an overall high levels of precision, recall, and F1-score in all ten distraction classes. Grad-CAM is used to produce attribution maps to improve interpretability by showing semantically important parts of the image, including hands, face, and mobile devices, and can give a visual explanation of why models make decisions. In addition, an ablation investigation is performed with k-fold validation to assess the value of the multi-head attention mechanism. Its model can run at 122 frames per second with 42.92 million parameters, showing that the suggested method is a reasonable tradeoff between accuracy, efficiency, and transparency and can be applied in real-time driver monitoring applications.

Read PDF

Similar papers

Conference Aug 2026

AI-Driven Human Behavior Analysis for Smart Surveillance Using Computer Vision and Explainable AI

The fast development of intelligent surveillance systems has enhanced the need to have intelligent and dependable analysis of human behaviour through computer vision methods. To overcome these obstacles, this paper presents an AI-enabled platform for analyzing human behavior in intelligent surveillance settings with th...

Anshu Vashisth, Gagandeep Kaur, Neha et al. · 0 citations
Open access Jul 2026

Adaptive YOLOv6-Driven Infrared Pedestrian Perception for Low-Visibility Intelligent Transportation Systems

The proposed framework provides an efficient and robust solution for nighttime pedestrian detection and can be integrated into advanced driver assistance systems and autonomous vehicles to improve road safety under low-visibility conditions.

Mohammod Asma Thahniyath, Sk.Mahammadunnisa · 0 citations
Open access 2024

Explainable Deep Learning Framework for Autonomous Transportation Safety

The proposed framework comprises sensor fusion, image processing, feature extraction, deep neural network inference and explainability mechanisms such as Gradient-weighted Class Activation Mapping, Local Interpretable Model-Agnostic Explanations and SHapley Additive exPlanations.

Johan Håstad's mentor Arne Andersson, Börje Langefors · 0 citations
Aug 2026

A Driver Behavior Detection Method Based on Improved YOLOv11 and an Attention Mechanism

This study presents a methodology to identify driver’s distraction using a refined You Only Look Once (YOLO) model, denoted as YOLOv11, which demonstrates higher accuracy and robustness, making it suitable for real-world driver monitoring system (DMS) deployments.

Bao Ma, Hamid Taghavifar, Zhi-Jun Fu et al. · 0 citations
Aug 2026

CAT-Net: a coordinate attention transformer network for workplace activity recognition

A hybrid deep learning (DL) model that integrates Coordinate Attention (CA), Convolutional Neural Networks (CNN), and Transformer encoders for better HAR achieves superior performance and proved its effectiveness for workplace safety monitoring applications.

E. Jyotsna, T. Jarin · 0 citations
Jul 2026

The LAIA Dataset: Labelled Attention for Intelligent Automobiles

The development of autonomous vehicles (AVs) usually relies heavily on data-driven artificial intelligence (AI) models that require large volumes of sensor data with ground-truth annotations. While modular architectures are widely used, end-to-end driving paradigms offer a promising alternative by directly mapping sens...

A. Contreras, Diego Porres, R. Abad et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.