Application of Reinforcement Learning for Optimizing the Capacitated Vehicle Routing Problem

Reinforcement learning for initializing genetic algorithms in vehicle routing

Vehicle routing problems (VRP) are an extension of the Traveling Salesperson Problem and are a fundamental NP-hard challenge in combinatorial optimization. Solving VRP in real-time at large scale has become critical in numerous applications, from growing markets like last-mile delivery to emerging use-cases like interactive logistics planning. Such applications involve solving similar VRP instances repeatedly, yet current state-of-the-art solvers treat each instance on its own without leveraging previous examples. We introduce an optimization framework where a reinforcement learning agent is trained on prior instances and quickly generates initial solutions, which are then further optimized by a genetic algorithm. This framework, Evolutionary Algorithm with Reinforcement Learning Initialization (EARLI), consistently outperforms current state-of-the-art solvers under limited time budgets. For example, EARLI handles vehicle routing with 500 locations within one second, 10x faster than current solvers for the same solution quality, enabling real-time and interactive routing at scale. EARLI can generalize to new data, as demonstrated on real e-commerce delivery data of a previously unseen city.

Vehicle routing problem using deep reinforcement learning - A case study about truck planning in the industry

As an important component of the supply chain industry, transportation has experienced rapid development in the past decade with the assistance of digital platforms and intelligent algorithms. Within the field of transportation research, Vehicle Routing Problem (VRP) has remained a persistent and enduring challenge. In the realm of management science, experts, and scholars from both the industrial and academic sectors have continuously explored optimization models and algorithms to effectively address routing problems, from the classical Traveling Salesman Problem to the more general Vehicle Routing Problem. These models and algorithms are applied in real-world industrial scenarios to achieve cost optimization and reduce carbon footprints. However, due to the complexity of real-world problems, numerous specific constraints are often added, and challenges such as information opacity, uncertainty, and irrational human behavior may arise. Therefore, deploying and optimizing mathematical models for VRP in practical scenarios while maintaining optimal results poses numerous challenges. This paper discusses and provides solutions for three different logistic use cases involving external truck network design. Through these industrial case study, the paper introduces how deep reinforcement learning-based vehicle routing optimization has been implemented. As a result, it can be observed that the routes optimized by reinforcement learning agent have over 10% total cost compared to baseline results. Furthermore, the paper proposes that in future research, DRL algorithms for vehicle routing problems could be generalized into more variations of VRP.

for Vehicle Routing Problems

A Reinforcement Learning Framework for Traveling Salesman and Vehicle Routing Problem with Drones

The Traveling Salesman Problem (TSP) and the Vehicle Routing Problem (VRP) are two classical combinatorial optimization problems. In recent years, their drone-assisted variants, the Traveling Salesman Problem with Drones (TSP-D) and the Vehicle Routing Problem with Drones (VRP-D) have attracted growing attention. Generally, these problems are solved using exact algorithms or metaheuristic algorithms. However, as the problem complexity increases and the scale of instances grows, these approaches often become less efficient. In this paper, we propose a reinforcement learning method with a shared attention encoder and a hierarchical dual-decoder architecture, where truck–drone coordination is achieved by first decoding the truck’s next node and then conditionally decoding the drone action. To further explore the solution space of large-scale instances, the proposed method adopts a multi-rollout learning strategy. We conducted experiments on large-scale TSP-D and VRP-D instances, and the results show that this model outperforms traditional metaheuristic algorithms in terms of both solution quality and computational efficiency.

Multi-Objective Reinforcement Learning for Smart Planning of Electric Vehicle Charging Stations

A hybrid optimization framework that combines greedy initialization with reinforcement learning to efficiently explore the charging station deployment problem is proposed and demonstrates stable performance across three evaluated deployment scenarios, indicating its potential applicability to increasingly complex charging infrastructure planning problems.

Adaptive primal–dual Q-learning for electric vehicle route optimization on real-world charging networks

A novel Dual Q–Adaptive Weighting model that balances reward and cost through a primal–dual learning mechanism is proposed and achieves the highest route accuracy of 78.66%, outperforming Double Q-Learning, Q-Learning, and traditional A* and Dijkstra algorithms.