Skip to content
Conference Open access

Rank-Based Softmax Ensemble of DQN and PPO for Adaptive Anti-Jamming Wireless Transmission

Aug 2026 · International Conference on Modelling, Identification and Control · pp. 57-60 · 0 citations · 10 references

TL;DR

A training-free Rank-Based Softmax Ensemble that fuses pre-trained Deep Q-Network and Proximal Policy Optimization agents at inference time for adaptive anti-jamming transmission and provides a rigorous comparative study of all three methods.

Abstract

Jamming attacks pose a critical threat to wireless communication systems, necessitating intelligent, adaptive countermeasures. This paper proposes a training-free Rank-Based Softmax Ensemble that fuses pre-trained Deep Q-Network (DQN) and Proximal Policy Optimization (PPO) agents at inference time for adaptive anti-jamming transmission and provides a rigorous comparative study of all three methods. The problem is formulated as a Markov Decision Process (MDP) with a 1,344-state space that captures jamming power, data queue occupancy, and energy buffer status. A normalized multi-objective reward incorporating a structural penalty Ωt eliminates deadlocks and neutral-action inflation. DQN and PPO are trained under identical configurations; the ensemble requires no training, dynamically adjusting fusion weights via credit-tracked softmax over a sliding lookback window. PPO achieves the highest overall return (≈585.1 balanced and ≈697.4 high throughput) and the fastest convergence. The proposed ensemble demonstrates competitive performance in high throughput (≈693.2) and outperforms both standalone models in the default and energy efficiency configurations (557.6 vs. PPO 551.7, DQN 520.7, and 530.2 vs. PPO 527.3, DQN 489.2, respectively) and a corresponding energy efficiency (η=56.69 vs. PPO 16.27, DQN 4.50), with the highest update rate (520 updates/sec), lowest inference latency (0.53 ms), and strongest jamming resilience, all at zero training cost. Practical algorithm selection guidelines are provided.

Read PDF

Similar papers

Open access Oct 2026

Anti-Jamming Algorithm Based on Stackelberg Game and Soft Actor-Critic

This paper studies a hybrid anti-jamming architecture using a Stackelberg game as its theoretical formulation in which a Soft Actor-Critic (SAC) agent selects a robustness radius and a power-control coefficient, while model-based power allocation and second-order cone programming determine transmit powers and receive-c...

K. Grigoryan, E. Basan, A. Nekrasov et al. · 0 citations
Open access Sep 2026

Energy-Efficient Anti-Jamming over Time-Varying Fading Channels via DQN-Based Joint Channel Selection and Power Control

Addressing the dual threats of malicious jamming and time-varying fading faced by wireless communication links in complex dynamic electromagnetic adversarial environments, existing intelligent anti-jamming methods predominantly focus on single-dimensional resource optimization under quasi-static channels. This focus ne...

Yu-Qi Wen, Ying-Tao Niu, Yu-Si Zhang · 0 citations
Open access 2026

Deep Unfolding-Based SCA for ISAC Non-Convex Precoding Design: Learning Adaptive Schedules

DU-SCA is proposed, a fixed-depth unfolding of nested proximal Successive Convex Approximation that replaces online Armijo searches and static schedules with learned layer-wise updates while preserving the optimization structure and is placed as a practical structured solution for feasible low-latency ISAC precoding.

Rafael Marasca Martins, B. F. Costa, L. Mathias et al. · 1 citation
Preprint Oct 2026

Digital-Twin-Referenced Belief-Guided Q-Learning for Jammer Identification and Beam-Power Control in a mmWave Model

Next-generation wireless networks are expected to support high data rates and reliable connectivity while meeting requirements for energy efficiency, resource management, and communication security. Digital Twin (DT) technology represents expected network behavior and enables the actual network state to be assessed aga...

Parmida Geranmayeh, Onur Günlü · 0 citations
Open access Oct 2026

Integrating unsupervised learning and deep reinforcement learning for anti-jamming in backscatter-aided 6G communications

This paper proposes a leakage-free unsupervised learning-aided D3QN framework for anti-jamming control in backscatter-aided 6G IoT communications. The proposed method first maps physical-layer observations, including SINR, RSSI, and estimated interference, into semantic states using unsupervised clustering, and then em...

Le Hoang Hiep, Huy Huu Ngo, T. N. Nguyen et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.