Skip to content
Conference

High-Level Semantic Instruction-Guided UAV Area Search Using LLM Agents

Aug 2026 · 2026 12th International Conference on Big Data and Information Analytics (BigDIA) · pp. 1203-1210 · 0 citations · 15 references

Abstract

Area search is a fundamental capability for unmanned aerial vehicles, but practical missions often begin with high-level semantic instructions and incomplete environmental information rather than a fully specified geometric search region. Large language model agents can interpret such instructions and interact with external tools, yet they are unreliable when directly responsible for long-horizon geometric coverage planning. This paper presents SAGE-UAV, a semantic agent-guided exploration framework for UAV area search that separates semantic decision making from low-level coverage path generation. The agent interprets mission intent, maintains task-level environment memory, invokes a deterministic area coverage planner, receives execution feedback, and iteratively refines the search strategy. The coverage planner supports circular and polygonal regions, single- and multi-UAV execution, and workload-aware lane partitioning for cooperative search. We evaluate SAGE-UAV on the Area Search subset of MultiUAV-Plat, covering 500 tasks across five difficulty levels. SAGE-UAV achieves a 69.4% task pass rate, outperforming the evaluated ReAct baseline by 32.4 percentage points. It also reaches an 85.0% average check pass rate. These results demonstrate the end-to-end effectiveness of the complete SAGE-UAV system in the evaluated partially observable benchmark.

View source

Similar papers

#artificial intelligence Preprint Sep 2026

Semantic Map Sharing and Capability-Aware Coverage Planning for AI-Native 6G Robotic Coordination

An edge-centric, semantic-aware coverage planning framework that integrates aerial terrain perception, robot-specific traversability reasoning, and payload-efficient semantic state sharing is proposed, motivated by AI-enabled goal-oriented communication envisioned for AI-native 6G networks.

Abdulqader Dhafer, Qi Wang, Z. Hao · 0 citations
Preprint Sep 2026

AgenticSwarm: Semantic Perception and Adaptive Task Allocation for Heterogeneous Multi-UAV Missions

Multi UAV missions in complex environments require the system to understand both the surrounding scene and the intent of a human operator while maintaining feasible task allocation as mission conditions change. This paper presents AgenticSwarm, an agentic framework for semantic perception and adaptive task allocation i...

Muhammad Ahsan Mustafa, Yasheerah Yaqoot, Faryal Batool et al. · 0 citations
Preprint Aug 2026

From Semantic Grounding to Decision Optimization: A Unified Framework for Long-Horizon UAV Vision-Language Navigation

This work presents an instruction-grounded semantic enhancement module that injects object-level semantics and relative spatial cues into the current observation state, and develops a relevance-aware dynamic temporal aggregation strategy that reweights the full history buffer while converting a few high-relevance frame...

Ze-Yuan Ma, Jiaxin Chen, Di Huang · 1 citation
2026

S-FUEL: A Semantic and Latency-Aware Framework for Target-Oriented UAV Exploration Using Onboard Foundation Models

Efficient exploration and target identification in unstructured environments are critical challenges in UAV automation. While foundation models like Segment Anything Model 3 (SAM 3) offer powerful open-vocabulary perception, their high computational cost and inference latency hinder real-time deployment on onboard hard...

Si-Tian Peng, Rui Wang · 0 citations
Conference Aug 2026

Talk-to-Fly: An Agentic LLM Runtime for Natural-Language UAV Task Control

The current integration of large language models (LLMs) with unmanned aerial vehicles (UAVs) offers a promising approach to more accessible UAV task control. However, existing methods utilise LLMs as one-shot planners, which are vulnerable to changes in vehicle state and dynamic operating conditions. This paper introdu...

Jack Morgan, Zhuang-Kun Wei, Hong-Jian Sun · 0 citations
Open access Nov 2025

UAVBench: An Open Benchmark Dataset for Autonomous and Agentic AI UAV Systems via LLM-Generated Flight Scenarios

UAVBench establishes a reproducible, physically grounded foundation for benchmarking agentic AI in autonomous aerial systems and advancing next-generation UAV reasoning intelligence, and presents UAVBench_MCQ, a reasoning-oriented extension containing 50,000 multiple-choice questions spanning ten cognitive and ethical...

M. Ferrag, Abderrahmane Lakas, Mérouane Debbah · 16 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.