A Novel Photogrammetry-Based Data Generation Technique for Post-Disaster Human Detection in UAV Imagery

Abstract

Recently, deep learning has enabled unmanned aerial vehicles (UAVs) to detect human bodies in aerial imagery, which is of particular importance in post-disaster situations such as floods and storms. Yet progress in this domain remains constrained by a familiar obstacle: the shortage of annotated training data. Neural networks, while powerful, are highly sensitive to data volume and diversity. Existing augmentation strategies help reduce this gap but typically introduce only incremental novelty, especially with respect to viewpoint variation, thereby limiting dataset richness. In this work, we propose a complementary strategy that leverages three-dimensional human models reconstructed via photogrammetric techniques. By situating these models within a controlled rendering environment, we generate synthetic imagery across a broad range of elevations and camera angles—perspectives that are rarely captured in conventional UAV datasets. These additions are designed to increase both the variability and the resilience of the training corpus. To evaluate the contribution of this approach, a custom CNN deep convolutional neural classifier was trained and benchmarked on a UAV human vs. non-human patch dataset of 4000 baseline images (128 × 128 px; 2800 train, 600 validation, 600 test), expanded with 3000 photogrammetry-derived synthetic patches (balanced by class) to 7000 total images for the 3DG setting. The primary metric was classification accuracy on the held-out test set, consistent with patch-level evaluation practice; detection-style metrics such as AP/IoU were not applicable to this binary classification protocol. Averaged over five independent training runs, the proposed augmentation improved classification accuracy by 3.02 percentage points over the baseline (88.06 ± 0.97% → 91.08 ± 1.03%), with consistent gains in precision, recall, and F1-score. When combined with standard augmentations (rotation, translation, scaling, flipping), accuracy reached 95.21 ± 0.61%, a gain of 7.15 percentage points over the baseline. These results suggest that photogrammetry-based augmentation offers a practical and effective enhancement for UAV-based human detection pipelines where timely, reliable identification is critical.