Skip to content
Preprint

A Multi-Sensor Dataset for Monitoring the Operational Environment of Rail Vehicles

Aug 2026 · 1 citation · 15 references
Computer Science

TL;DR

This dataset contains over 7 million high-quality annotations of both railway-specific and general perception objects, captured under varying operational scenarios, to serve as a valuable resource for advancing AI-driven environment monitoring in the railway domain.

Abstract

Reliable environment monitoring is essential for the safe and efficient operation of automated railway systems, covering all Grades of Automation (GoA), from partially automated (GoA2) to fully automated operation (GoA4). Artificial Intelligence (AI) plays a central role in enabling these systems to detect, classify, and react to potential hazards in real time. The development of such AI-based perception systems requires large volumes of accurately annotated data for training and validation. Within the Digitale Schiene Deutschland (DSD) program, DB InfraGO AG and understandAI GmbH have developed a comprehensive multi- sensor dataset tailored to the needs of railway environment perception. This dataset contains over 7 million high-quality annotations of both railway-specific and general perception objects, captured under varying operational scenarios. The finalized dataset can now be requested at the DB InfraGO AG and serve as a valuable resource for advancing AI-driven environment monitoring in the railway domain.

View source

Similar papers

Review Open access Jul 2026

The Emerging Role of Vision-Language Models in the Automation of Railway Asset Management: A Review and Future Perspective

This review paper argues that Vision-Language Models (VLMs), a paradigm whose rapid maturation is evidenced by recent comprehensive surveys offer a transformative solution for rail asset management, and provides a focused overview of the limitations of current CV systems.

Ashley Varghese, Mohammadjavad Ghorbanalivaki, Gunho Sohn · 0 citations
Open access Aug 2026

Development of an RAG-Integrated Agentic BIM System for Intelligent Railway Maintenance

This framework proves an autonomous decision-making system that organically links inspection data with maintenance regulations by transforming static, manual-labor-centered maintenance workflows into intelligent automated models and increases the efficiency of railway infrastructure management while providing a scalabl...

Minjae Jeon, Yong-Gyun Kim, Seok-Han Kim · 0 citations
Open access Sep 2026

Multi-sensor system for efficient in-service vehicle-based track monitoring and fault localization: a case study

As the requirements for railway operators to offer a safe and economically efficient transportation service have become extremely difficult to met due to the size and complexity of the rail network, vehicle-based track monitoring and fault detection have gained relevance as a way to abate maintenance-related costs vi...

Héctor A. Fernández-Bobadilla, R. Frolow, Laura T. Rodríguez-Bayona et al. · 0 citations
Open access 2023

Development of Autonomous Monitoring Drones for Infrastructure Inspection

This study proposes an AI-enabled autonomous drone framework for infrastructure inspection that integrates intelligent flight planning, automated data collection, computer vision-based defect detection, and condition assessment that enhances inspection accuracy, operational safety, and scalability compared to tradition...

Yuki Nakamura · 0 citations
Review Open access Jul 2026

Intelligent Perception Systems for Vehicles: A Review of Observation Technologies in Environmental Risk Mitigation and Resource Optimization

This review discusses important sensor technologies, such as cameras, Light Detection and Ranging (LiDAR), radar, and ultrasonic sensors, as well as AI-based decision-making systems that enable vehicles to respond to changing driving conditions.

Min Li, Qiao-Sheng Bo, Junrong Huang et al. · 0 citations
Conference Open access 2026

Multi-Sensor Fusion Strategies for Robust Autonomous Driving Perception under Adverse Weather and Complex Urban Traffic Conditions

This study shows that when multi-sensor fusion strategies are rationally designed, the constraints of a single sensor used to sample the environment can be addressed, and this strategy plays an important role in increasing the resilience of the system as well as its ability to understand its surrounding.

Zhi-Xiang Xu · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.