This work designs a scalable CoT curation pipeline that bootstraps rationales from a strong LLM through a two-round strategy and employs a VLM-based verifier to filter out incorrect cases, yielding a high-quality set of (CoT, answer) pairs.
Abstract
Understanding and complying with traffic regulations is a safety-critical requirement for autonomous driving, yet remains challenging due to the diversity and context dependence of traffic signage. Importantly, regulation understanding is not a simple recognition task, but a reasoning problem: whether a rule applies depends on interpreting the sign in relation to the spatial layout of lanes and scene context. To support such reasoning, MapDR provide fine-grained annotations that link each traffic sign's regulatory rules to the specific lanes they govern. Existing methods, however, largely treat this as direct sequence prediction, ignoring the underlying reasoning that connects sign semantics and map structure. To address this limitation, we explicitly incorporate reasoning into this task and propose a framework that equips vision-language models (VLMs) with chain-of-thought (CoT) capabilities. We first design a scalable CoT curation pipeline that bootstraps rationales from a strong LLM through a two-round strategy and employs a VLM-based verifier to filter out incorrect cases, yielding a high-quality set of (CoT, answer) pairs. Building on this foundation, we adopt a two-stage training scheme: supervised fine-tuning (SFT) to teach rationale-to-answer generation, followed by GRPO reinforcement learning with answer-grounded, fine-grained rewards to further improve final answer accuracy. Extensive experiments on MapDR show that our approach significantly improves both interpretability and accuracy, establishing the first reasoning-based framework for regulation-aware autonomous driving.
STGraphVQA, a framework that represents driving scenes as dynamic spatiotemporal graphs, where nodes denote traffic participants, edges encode spatial and semantic relationships, and the temporal dimension captures their evolution, provides a promising direction toward interpretable autonomous driving systems.
Dengquan Zhang, Jiayi Wu, Qingshan Wang et al.· International Conference on...· 0 citations
This work introduces a robust "first-detect-then-reason" framework that incorporates a large language model (LLM) as an agent, which first employs TopoMLP++ to generate pseudo-labels, and proposes an agent-based data engine that utilizes the predictions from TopoMLP++.
Dongming Wu, Wen-Cheng Han, Cheng-Zhong Xu et al.· IEEE Transactions on Pattern...· 0 citations
The introduction of ChainSpace, a chained-reasoning paradigm that structures spatial reasoning as a state-preserving multi-round process, is introduced as an effective paradigm for more faithful evaluation and more data-efficient learning of spatial intelligence.
Xiao-Han Zhang, Feng Gu, Xudong Rao et al.· 0 citations
WorkDrive is proposed, a framework that constructs perception-grounded causal reasoning for work zones and aligns it with trajectory prediction and achieves progressive improvement over the trajectory-only baseline.
Tianyi Jiang, Wen Zhang, Sihan Yang et al.· arXiv.org· 0 citations
Autonomous vehicles (AVs) operate in complex environments where failures are consequential. Sophisticated machine learning models for perception and planning are key to overcoming at least part of that complexity, but their black-box nature complicates validation and verification (V&V). The recent integration of Vision...
Tianwen Yu, Lu Feng, Sebastian G. Elbaum· 0 citations
FlightLLM, a prior-guided semantic LLM-based approach for interpretable flight safety analysis that achieves competitive classification performance while generating direct and reasonable explanations for event causes is proposed.
Lu Xu, Xu Li, Linjiang Zheng et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.