Skip to content
Preprint

Drones as Annotators: Amodal 3D Auto-Labeling for Ground LiDAR with Aerial Priors

Sep 2026 · 0 citations · 36 references
Engineering

TL;DR

DAA (Drones as Annotators), a drone-assisted training-free framework for amodal 3D auto-labeling, is introduced and evaluated on an air-ground cooperative perception dataset, where it consistently outperforms existing auto-labeling baselines.

Abstract

Scaling perception data in autonomous driving is hindered by manual 3D bounding box annotation, a costly and labor intensive process requiring substantial domain expertise. Existing auto-labeling methods reduce this burden, but most of them rely on onboard sensors, where a single ground-level viewpoint yields occluded and sparse observations and inaccurate object geometry. We introduce DAA (Drones as Annotators), a drone-assisted training-free framework for amodal 3D auto-labeling. DAA augments ground LiDAR with an aerial agent that provides less occluded vehicle detections with continuous tracks. Ground LiDAR, in turn, provides precise metric 3D geometry unavailable from aerial imagery alone. DAA exploits the two complementary yet heterogeneous modalities through a two-stage framework: (i) air-ground coordinate alignment unifies aerial detections and ground LiDAR scans into a shared map frame and bootstraps coarse 3D bounding boxes from the aligned aerial detections; (ii) EM-like amodal box refinement alternates between identifying the vehicle's foreground points and updating the coarse box from the identified foreground and aerial priors. We evaluate DAA on an air-ground cooperative perception dataset, where it consistently outperforms existing auto-labeling baselines. LiDAR detectors trained on DAA-generated labels remain competitive with those trained on manual annotations at moderate IoU thresholds. Evaluation against a reference vehicle with known poses and dimensions further confirms its accuracy. We also demonstrate that DAA transfers, without parameter retuning, from onboard to stationary roadside LiDAR and to multi-agent fused point clouds. Code and dataset will be released upon publication.

View source

Similar papers

Preprint Oct 2026

Lang3DSeg: Annotation-Free Open-Vocabulary 3D Segmentation with Point Transformers

Accurate 3D semantic perception is critical for safe autonomous navigation. However, supervised LiDAR segmentation remains tied to closed taxonomies and to the cost of point-wise manual annotation. Open-vocabulary methods avoid that cost by projecting the output of 2D vision-language models onto LiDAR and distilling it...

Cigdem Kokenoz, A. Salarpour, Alkim Domeke et al. · 0 citations
Sep 2026

Towards robust multimodal 3D object detection via visual foundation models

This work introduces SAM-AD, a domain-specific pretraining strategy that fine-tunes SAM on autonomous-driving imagery to extract feature representations with rich semantic information, and develops the Depth-Guided Wavelet Attention (DGWA) module, which suppresses high-frequency sensor noise while preserving critical c...

Zi-Ying Song, Lin Liu, Hong-Yu Pan et al. · 0 citations
Conference Open access Oct 2026

PRUNE: Selective LiDAR-Camera Projection via Multi-Stage Evidence Rejection for Semantic Fusion in Unstructured Forests

Autonomous navigation in unstructured outdoor environments such as forests requires robust multimodal perception, where projecting Light Detection and Ranging (LiDAR) point clouds onto red green blue (RGB) camera images is a key step. Yet, geometrically valid projections can still be semantically unreliable because of...

M. E. Andrada, David Portugal, Paulo Peixoto et al. · 0 citations
Preprint Oct 2026

MultiFly: A Real-World Multimodal Aerial Dataset with Annotation-Efficient Label Transfer and Cross-Modal Semantic Consistency

MultiFly is introduced, a real-world, low-altitude UAV dataset for semantic perception across RGB, thermal, LiDAR, and radar modalities, and the first public real-world low-altitude aerial benchmark that combines consistent frame-wise semantic annotations for RGB, thermal, LiDAR, and radar.

Markus Gross, Andreas Greiner, Taehyoung Kim et al. · 0 citations
Preprint Nov 2026

ProAlign: Progressive Positional and Prototype-Guided Alignment for Aerial-Ground Person Re-Identification

Aerial-Ground Person Re-Identification (AG-ReID) aims to match pedestrian images captured by unmanned aerial vehicles (UAVs) and ground-based surveillance cameras. The task remains highly challenging due to severe viewpoint discrepancies, frequent occlusions, and substantial domain gaps between aerial and ground imager...

Qiao Li, Jing Chen, Cong Wu et al. · 0 citations
Sep 2026

Retrieve-to-Localize: Bridging Large Language Models and LiDAR Geometry for Spatial Grounding

LiDAR provides precise geometric information for spatial perception tasks such as object detection in autonomous driving and outdoor robotics. However, recognizing and localizing individual objects is not sufficient to answer questions that require composing spatial relations and grounding the intended target. Motivate...

Byounggun Park, Giyong Moon, Jusung Kim et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.