Intelligent optimization of personalized learning path based on transformer and reinforcement learning.

Abstract

Smart education platforms accumulate large volumes of learning resources and interaction logs. However, fixed recommendation sequences are often unable to adapt to differences in knowledge foundations, learning behaviors, and cognitive progress among learners. Existing learning path recommendation methods primarily focus on static matching and single-step ranking, while providing limited support for modeling learning state evolution and long-term path benefits. To improve learning resource recommendation accuracy, path continuity, and learning completion outcomes, a personalized learning path (PLP) optimization model integrating Transformer and Reinforcement Learning is developed. The model aims to generate learning resource sequences that align with individual cognitive processes through dynamic state awareness, sequential policy decision-making, and the incorporation of educational constraints. First, learning behavior sequences, knowledge point information, answer feedback, resource access records, and time intervals are encoded within a unified framework. A Transformer is employed to capture long-range dependencies and dynamic state features. Second, PLP generation is formulated as a continuous decision-making process, in which RL performs policy search within the candidate resource space. Finally, knowledge prerequisite relationships, difficulty progression rules, learning load boundaries, and a multi-objective reward function are incorporated into a unified optimization framework. Offline simulation experiments are conducted on three public datasets, namely EdNet, ASSISTments, and Junyi. Performance is compared with Self-Attentive Knowledge Tracing, Separable Self-Attentive Neural Knowledge Tracing Plus, Unified Knowledge Tracing (UniKT), and Time-Aware Reinforcement Learning. Experimental results indicate that Transformer and Reinforcement Learning for Learning Path (TFRL-Path) achieves a hit ratio of 0.846 on EdNet, exceeding UniKT by 0.025. On ASSISTments, the mean average precision reaches 0.737 and the completion rate reaches 0.801. On Junyi, precision reaches 0.736 and convergence epochs decrease to 38. The cross-dataset average composite score reaches 0.798 with a standard deviation of 0.028. The prerequisite satisfaction rate reaches 0.872, while the resource repetition rate decreases to 0.121. These findings suggest that closed-loop coordination among state representation, policy optimization, and educational constraints contributes to improvements in personalized learning path recommendation quality.