Skip to content

REARL: A Closed-loop Autonomous Driving Simulation Enhancement Framework with Real Traffic Data and Large Language Models

Sep 2026 · 0 citations · 53 references
Computer Science

TL;DR

REARL, a closed-loop simulation enhancement framework that integrates real traffic data with large language model (LLM) and modulates the simulated vehicle with reference to that real action, is proposed.

Abstract

Accurate simulation is crucial for autonomous driving development, yet capturing real-world traffic complexity remains challenging. Existing simulators that rely on predefined rules or static data playback struggle with dynamic traffic. CRITICAL uses real traffic data and a large language model (LLM) to adjust the initial simulation configuration, but the simulated distribution still diverges from real traffic as the rollout evolves. We propose REARL, a closed-loop simulation enhancement framework that integrates real traffic data with LLMs. Real traffic data are clustered, and each cluster center is used as a representative scenario that provides typical real-world traffic patterns for the LLM. A timed sliding-window detector then monitors discrepancies in vehicle speed distribution and mean spacing between pairs of vehicles. If a metric exceeds a threshold, the LLM adjusts vehicle decision-making; otherwise the existing controller is kept. The LLM also selects a matching real vehicle from a traffic snapshot and modulates the simulated vehicle with reference to that real action. In a controlled HighD highway setting, compared with the CRITICAL baseline and a PPO-based learning baseline, REARL reduces the Hellinger distance for speed distributions to 0.3067 and the MAPE for mean spacing to 0.8371, while achieving a time headway (THW) of 22.8575 and a lane change rate of 0.0708.

View source

Similar papers

Preprint Sep 2026

TrafficSignBench: Rule-Centric Closed-Loop Evaluation of Traffic-Sign Compliance in Autonomous Driving

Autonomous driving planners are typically evaluated using aggregate metrics such as driving score, destination rate, and collision rate, which do not explicitly measure compliance with traffic rules. As a result, planners can achieve high benchmark scores while still exhibiting unsafe or illegal behaviors, limiting the...

Victoria Smirnova, V. Zinkovich, Gregorii Bukhtuev et al. · 0 citations
Open access Sep 2026

LLM-Driven Signal Control Method for Signalized Intersections with Mixed Traffic Flow

This paper proposes integrating a Large Language Model (LLM) into signal control: roadside devices perceive traffic states, prompt engineering is constructed, and the LLM is driven to reason and generate control signals, on this basis, a CAV speed guidance algorithm is proposed.

Jun-Yao Lin, Yi-Cai Zhang, Tao Wang · 0 citations
Open access Oct 2026

Are We Stuck? Modeling and Detecting Deadlocks in Multi-autonomous Vehicle Systems

Autonomous driving system (ADS) testing is essential to ensure the safety and reliability of autonomous vehicles (AVs) prior to deployment. As ADSs are increasingly deployed in multi-AV traffic environments, it becomes crucial to assess their cooperative performance, particularly with respect to deadlock, a fundamental...

Ming-Fei Cheng, Xiao-Fei Xie, Li-Li Quan et al. · 0 citations
Preprint Aug 2026

Validation of a driver model for energy consumption simulations of road vehicles

The energy performance of road vehicles has traditionally been evaluated using driving cycles, in which a prescribed speed profile is tracked either in simulation or by a physical vehicle. Recent research has proposed an alternative framework based on operating conditions, where the driving environment is described in...

Luigi Romano, M. Godio, F. Bruzelius et al. · 0 citations
Open access Sep 2026

The IoV-TraSim: IoT-Enabled V2X Adaptive Traffic Simulation for Real-World Urban Congestion Mitigation

An IoV-TraSim framework for adaptive traffic simulation based on vehicle-to-X communications is proposed, which incorporates the road topology derived from OpenStreetMap, the V2X sensing infrastructure modelled by RSU/OBU, microscopic agent-based vehicle movement, congestion-aware speed modulation, and a heuristic cali...

M. M. Abed, S. N. Maryoush, M. K. Musa · 0 citations

Related blog posts

MIT News · Artificial Intelligence Nov 17, 2026

Learning the language of machine learning

By studying the computational foundations of language learning, Associate Professor Jacob Andreas builds intelligent systems that can communicate effectively with humans.

Microsoft Research Blog Nov 16, 2026

TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient

AI coding agents are increasingly help developers fix bugs and build features largely on their own, but every interaction with their models consumes tokens. In each session, an agent sends instructions, tool descriptions, and session history to its model. Most efforts to reduce this cost focus on individual tasks. Yet developers return to the same […] The post TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.