Skip to content
Open access

Radar--Camera Fusion Vehicle Detection Algorithm With Adaptive Constraints on Point Cloud Depth and RCS

Sep 2026 · IEEE Sensors Journal · Vol 26, pp. 28131-28148 · 0 citations · 30 references

Abstract

In traffic scenes, the degradation of radar point cloud angle-of-arrival estimation accuracy with increasing distance leads to reduced discriminability and spatial response dispersion of radar–camera fusion features in bird’s-eye view (BEV) space. To address this issue, an improved Astra-HGSFusion radar–camera fusion vehicle detection algorithm is proposed. The method integrates an adaptive radar hybrid generation module (ARHGM) that jointly constrains virtual point cloud generation by target depth and radar cross-section (RCS), a multipooling feature encoding mechanism, and a shareable multisemantic spatial attention mechanism. Specifically, a hybrid sampling strategy combining depth-adaptive Gaussian kernels and RCS-adaptive sampling is introduced, with semantic information utilized for auxiliary generation to enhance the virtual point cloud. The multipooling feature encoding effectively preserves fine-grained spatial information within Pillars, while a multisemantic spatial attention module is incorporated into the radar branch feature pyramid network to strengthen target feature responses in the BEV representation. Consequently, the proposed algorithm demonstrates superior detection performance in sparse radar scenarios. Experimental validation on the View-of-Delft (VOD) and TJ4DRadSet datasets shows that the proposed method achieves mean average precision (mAP) scores of 81.07% and 60.96% in the driving region and the fully annotated region, respectively, representing improvements of 2.20% and 3.19% over the HGSFusion baseline. Furthermore, BEV mAP and 3-D mAP are enhanced by 3.40% and 3.70%, respectively. Simulation results demonstrate that the algorithm effectively mitigates missed detections and localization errors for distant and small-scale targets, providing valuable theoretical reference for multimodal point cloud-image perception in intelligent transportation systems.

Read PDF

Similar papers

Conference Nov 2026

A multimodal 3D object detection framework based on hybrid radar point generation and dual synchronization fusion

Aiming at the instability of 3D object detection caused by sparse radar point clouds and illumination-susceptible image features in complex traffic scenarios, this paper constructs an intelligent perception algorithm system based on radar-vision collaboration. Taking hybrid radar point generation, distributed point fea...

Li-Han Yang · 0 citations
Book Open access Nov 2026

Radar-Camera 3D Object Detection via Density- and Intensity-Guided Refinement with Reliability-Aware Fusion

Radar-camera 3D object detection has shown great promise for autonomous driving, yet the inherent sparsity and noise of radar point clouds continue to hinder the detection performance. Existing methods typically adopt single-branch radar enhancement, which struggles to balance feature completeness and suppress noisy re...

Rui Zhao, Shuo-Yao Wang, Xin-Hu Zheng et al. · 0 citations
Book Open access Nov 2026

ElevC2F: Elevation-Aware Coarse-to-Fine Fusion of 4D Radar and Camera for 3D Object Detection

While the fusion of 4D millimeter-wave radar and camera holds significant potential for 3D object detection in autonomous driving, the extreme sparsity of radar points and the deficiency of depth information in images lead to severe cross-modal spatial misalignment. Existing two-stage methods might suffer from the irre...

Yu-Zhe Song, De-Xing Lin, Jian Chen et al. · 0 citations
Open access 2026

DLP-Pillars: A LiDAR 3D Object Detection Method With Adaptive Re-Encoding and Multidimensional Feature Enhancement

3D object detection is a core task in intelligent perception, and LiDAR point clouds provide precise spatial geometric and scale information. To address issues such as high sparsity, non-uniform distribution, and insufficient feature representation of distant objects in LiDAR point clouds, this paper proposes DLP-Pilla...

Yu-Yu Sun, Ming-Xiao Yang, Zong Shang et al. · 0 citations
Open access Nov 2026

RadarFuser: One-Stage Radar-Camera Depth Estimation With Early and Point-Guided Fusion

Depth estimation is fundamental to vision applications, but recovering metric depth from a single image remains challenging due to scale ambiguity. Radar-camera depth estimation offers a practical solution by combining dense visual cues with weather-robust radar measurements, yet the extreme sparsity and noise of radar...

Cheng-Hao Zhang, Fu-Yi Zhang, Zhu Yu et al. · 0 citations
Open access Nov 2026

DVFusion: Dual-View Attention and Geometry-Guided Fusion for 4D Radar-Camera 3D Detection

4D radar-camera fusion has attracted increasing attention for reliable 3D perception under adverse weather conditions. However, existing methods either lose valuable radar information by using sparse point clouds, or suffer from high computation when processing raw tensors directly. To address these challenges, this pa...

Li-Wei Luo, Xia Wu · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.