Skip to content
Log in

Feedback-Driven Population Self-Evolution Framework for Dispatching Rule Generation in Dynamic Job Shop via Knowledge Distillation

Jin Huang Zhengqi Shi Qihao Liu Xinyu Li Liang Gao
2026 · IEEE Transactions on Automation Science and Engineering · Vol 23, pp. 14234-14247 · 0 citations · 46 references

Abstract

The dynamic job shop scheduling problem (DJSSP) is critical for optimizing production efficiency in intelligent manufacturing systems under dynamic constraints. Traditional approaches, including heuristic dispatching rules (HDRs) and evolutionary hyper-heuristics, often struggle to generalize across dynamic and unseen scheduling scenarios. The advent of large language models (LLMs) offers new opportunities for scheduling optimization, yet their deployment in real-world manufacturing is constrained by data privacy concerns that limit the use of online LLM services and by the restricted inference capability of local small-scale models. To address these challenges, this paper proposes a novel feedback-driven self-evolution framework employing dual-stage knowledge distillation. The framework utilizes a feedback-driven refinement mechanism to distill expert knowledge from advanced LLMs, which is then used to fine-tune the Qwen2.5-Coder-7B model into ModouGPT, a specialized model for generating HDRs. Experimental results indicate that our approach performs better than traditional methods and five state-of-the-art LLM-based evolutionary frameworks, particularly in dynamic and unseen scheduling scenarios. ModouGPT demonstrates competitive performance with online LLMs in complex dynamic environments, while ensuring data privacy. This study provides manufacturing enterprises, particularly small and medium-sized enterprises, with a deployable scheduling system that balances intelligence, privacy, and computational efficiency in dynamic job shop environments. Note to Practitioners—DJSSP involves constant disruptions such as machine breakdowns and dynamic order arrivals. Deploying artificial intelligence (AI)-based scheduling in real manufacturing environments remains difficult: cloud-based LLM services risk exposing sensitive production data, while large-scale local models demand prohibitive hardware investments, placing both options out of reach for most enterprises. This paper presents a practical solution. The proposed framework distills scheduling knowledge from a powerful online teacher model into a compact 7B local model, ModouGPT, deployable on a single consumer-grade graphics processing unit (GPU). All scheduling decisions are made entirely on-premises, with no data leaving the factory floor. Practitioners do not need domain expertise to design HDRs. The system automatically generates HDRs tailored to the specific production environment, covering job processing characteristics and dynamic disturbances. An offline HDR library can be built in advance and updated periodically without interrupting production, and new HDRs can be synthesized in under one minute during live operations. This makes the system immediately actionable for engineers seeking to upgrade scheduling capabilities without relying on external LLM services or specialized algorithm designers.

DOI Semantic Scholar
View source

Similar papers

Book Open access Jul 2026

LLM Policy Induction for Heuristic Search Control: A Trace-Driven ALNS Framework

Experimental results demonstrate that the proposed framework consistently outperforms classical ALNS baselines and several competitive metaheuristic methods in terms of solution quality and convergence speed.

T. M. Nguyen · 0 citations

Preference-Guided Multi-Policy Optimization for Flexible Job Shop Scheduling

PGMPO is proposed, a novel learning framework consisting of a simple but effective multi-policy modeling approach that allows a single network to represent multiple decision-makers, and a preference-driven model optimization method that effectively guides policies to learn diverse and specialized problem-solving strategies without the need for explicit reward functions.

Inguk Choi, Woo-Jin Shin, Sang-Hyun Cho et al. · 0 citations
Open access Jul 2026

Preference-Conditioned Reinforcement Learning for Energy-Aware Multi-Objective Flexible Job Shop Scheduling

Rising energy costs and the increasing share of renewable generation create incentives to align production schedules with dynamic electricity prices and on-site solar generation. We address the resulting Multi-Objective Flexible Job Shop Scheduling Problem by proposing a deep reinforcement learning framework that jointly minimizes makespan and energy cost. A single preference-conditioned policy approximates the Pareto front at inference time, eliminating the need to train separate models for different objective weightings. The agent acts as a hyper-heuristic, selecting among heuristic actions at each decision point, including strategies that intentionally delay operations to exploit periods of lower electricity prices or higher solar generation. Preferences are integrated throughout the network via Feature-wise Linear Modulation, while a dual-critic architecture and a diversity loss preserve preference-specific policy behaviors. We evaluate the approach against NSGA-II and Joined Heuristics on synthetic instances ranging from 10×5×5 to 15×15×15 jobs, operations per job, and machines using normalized hypervolume and inverted generational distance. While NSGA-II performs best on the smallest instances, the proposed approach becomes increasingly competitive as problem size grows and achieves the best results on the largest evaluated instances. These findings indicate promising scalability within the investigated problem range.

Dustin Moreira Simoes, Marvin Brune, Mehmet Ulrich et al. · 0 citations
Open access 2026

Refined Environmental Design for Reinforcement Learning Framework in Job Shop Scheduling

Machine failures, which represent forms of performance degradation, are common in real-world manufacturing systems, however, they are often overlooked in job shop scheduling solutions that primarily focus on complete machine breakdowns. These subtle disruptions can lead to cascading delays and reduced system efficiency. This study proposes a reinforcement learning (RL) framework designed to address the Job Shop Scheduling Problem (JSSP) in environments affected by such failures. Unlike traditional RL-based scheduling models that concentrate on total breakdowns, this work considers more nuanced disruptions, such as processing slowdowns, which frequently occur in practical settings. The proposed framework enhances a Q-learning algorithm by introducing a refined environment that incorporates an extended state representation and a reward function tailored to account for performance degradation. These enhancements enable the RL agent to learn adaptive scheduling policies that minimize makespan while effectively responding to partial machine failures. The framework is validated using the Taillard benchmark dataset across varying levels of disruption and job-machine configurations. Experimental results show that the proposed environment consistently delivers superior scheduling performance compared to baseline models that do not consider machine failures. The findings highlight the framework’s potential to improve scheduling resilience and efficiency in dynamic production environments.

Pakkaporn Saophan, Pakorn Uttayopas, Thus Kanjanapatchara et al. · 0 citations