Reinforcement-Learning-Driven Joint Frequency and Beamforming Optimization for Adaptive mmWave Wireless Power Transfer to UAVs
Abstract
To design an adaptive millimeter-wave (mmWave) Wireless Power Transfer (WPT) system that dynamically optimizes carrier frequency and beamforming parameters to maintain Unmanned Aerial Vehicle (UAV) operations in Beyond-5G (B5G) networks. The proposed framework utilizes a reinforcement learning (Q-learning) controller to adapt transmission parameters in real time. The system was evaluated using MATLAB simulations integrating ITU-R standardized atmospheric channel models (accounting for rain, fog, and molecular absorption) across diverse environmental profiles including urban, rural, desert, and subzero settings. The adaptive scheme improved received power by up to 10 dB compared to staticfrequency baselines, yielded an additional 3 to 5 dB gain in urban Non-Line-of-Sight (NLoS) conditions, and demonstrated a 15-20% efficiency increase over traditional sub-6 GHz systems. By synchronizing intelligent frequency switching with adaptive beam steering, the system effectively mitigates severe environmental impairments and spatial misalignments caused by UAV mobility. The reinforcement-learning-driven joint optimization framework significantly enhances the robustness, efficiency, and reliability of mmWave WPT, offering a resilient solution to support persistent UAV operations in dynamic conditions.