Skip to content
Conference

A Multimodal Deep Reinforcement Learning Framework for Autonomous UAV Navigation in Gazebo–ROS Environments

Aug 2026 · 2026 International Conference on Secure Information Systems and Technologies (ICSIST) · pp. 690-697 · 0 citations · 32 references

Abstract

Unmanned Aerial Vehicle (UAV) autonomous navigation is a key capability for UAVs, particularly when in complex and dynamic environments where continuous human control is impractical. While commonly used rule-based navigation and path-planning techniques can be effective in structured environments, they can be ineffective when the environment is unknown, obstacles are moving, or sensor data is noisy. A UAV navigation framework based on DRL methods, including DQN, PPO, and the Actor-Critic algorithm, is presented. The proposed system is developed and evaluated in a Gazebo-ROS simulator with multimodal sensor input: camera, LiDAR, and IMU. UAV navigation is modeled as a Markov decision process (MDP), and the agent learns navigation decisions through continuous interaction with the environment. The success rate, collision rate, cumulative reward, path length, time to goal, and convergence episodes are used to compare the performance of the three DRL algorithms. Results show that PPO outperforms the other algorithms in every aspect, having the highest success rate, the lowest number of collisions, the highest convergence rate, and the smoothest navigation behavior. Actor–Critic can also be well adapted to a dynamic environment, whereas DQN is less suitable for continuous UAV control due to its discrete action space. The results show that DRL-based navigation is feasible in simulation and reveal the research challenges UAVs will face in the real world.

View source

Similar papers

Conference Open access Sep 2026

DQN-Based Autonomous UAV Target Navigation in a GridWorld Environment with a Q-Learning Baseline

This study presents a Deep Reinforcement Learning (DRL)-based autonomous target navigation approach for an unmanned aerial vehicle (UAV) in a simulated 2D GridWorld environment. The UAV is modeled as an agent that learns to reach a target by selecting one of four discrete actions: up, down, left, and right. A custom Gy...

Furkan Polat, Hilal Haznedar · 0 citations
Open access 2026

GenAI-Nav: Large-Multimodal-Model-Assisted Autonomous Navigation and Mission Reasoning for UAVs

: Unlike conventional Unmanned Aerial Vehicle (UAV) systems with static operations, long-horizon understanding, multimodal fusion, and safe decision-making can no longer be handled by conventional control and Reinforcement Learning (RL) methods. This study proposes GenAI-Nav, a Large Language Model (LLM)-assisted UAV n...

A. Abdusalomov, J. Sevinov, Mukhriddin Mukhiddinov et al. · 0 citations
Sep 2026

Reinforcement Learning-Based Adaptive Path Planning for Autonomous Vehicles in Unpredictable Urban Environments

Autonomous vehicles (AVs) are transforming transportation by enabling intelligent, self-governing mobility. A crucial challenge in AV deployment is real-time path planning under dynamic and unpredictable road conditions. Traditional algorithms such as A* and Dijkstra, while effective in static environments, lack the fl...

K. Priya · 0 citations
Open access Sep 2026

A forecast-guided reinforcement learning approach for trajectory planning of unmanned aerial base stations

The proposed Forecast-SAC framework demonstrates that unified predictive-control learning enables safe and efficient UAV-BS navigation under dynamic uncertainty, achieving a strong safety–throughput balance that reactive methods cannot match in high-risk environments.

Tariq, Zhuo-Xiu Wei, K. Shaukat et al. · 0 citations
Review Open access Oct 2026

GridMind: Multi-Agent Navigation Using Reinforcement Learning in a 3D Environment

GridMind is positioned as a controlled research environment in which multiple agents learn navigation policies in a discrete grid while the same environment is rendered as an interactive 3D simula-tion.

Manya D, Mugdha P, N. S. et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.