Joint DQN Optimization of Task Offloading and Resource Allocation for Low-AoI in IoV

Abstract

With the advancement of autonomous driving and smart navigation, Internet of Vehicles (IoV) systems face stringent requirements for real-time data delivery and processing reliability. Traditional metrics cannot fully capture information timeliness due to network dynamics and packet loss. Existing approaches also struggle with the coupling between task offloading and resource allocation, lacking adaptability in dynamic IoV environments. To address these issues, we propose a joint optimization scheme using a deep Q-network (DQN). Specifically, we build an IoV system model incorporating V2V and V2I communication, and formulate an optimization problem to minimize the average age of information (AAoI) under delay, bandwidth, computing, and energy constraints. We then design a mixed-action DQN algorithm with dual-network architecture, experience replay, and an action mask mechanism to enhance training stability and environmental adaptability. Simulation results show that our DQN-based scheme achieves the lowest AAoI among Random, Greedy, A2C, and DDQN, with reductions of 29.5%, 8.9 %, 7.1 %, and $\mathbf{7. 6 \%}$, respectively. It also exhibits superior delay and energy performance, confirming its effectiveness for dynamic IoV task offloading and resource allocation.