Adaptive Control of Lower-Limb Assistive Exoskeleton for Rehabilitation Using Deep Reinforcement Learning

Abstract

Lower-limb rehabilitation exoskeletons have the potential to improve gait recovery after stroke by providing intensive and repetitive training. However, conventional control strategies often rely on fixed control parameters and exhibit limited adaptability to patient-specific characteristics, sensor noise, and dynamic uncertainties. This paper proposes an adaptive control framework that combines deep reinforcement learning (RL) with model-based impedance control for personalised lower-limb exoskeleton assistance. Patient-specific biological parameters are incorporated into the simulation environment and reward formulation to improve adaptability and robustness. Three state-of-the-art deep RL algorithms, Deep Deterministic Policy Gradient (DDPG), Twin Delayed Deep Deterministic Policy Gradient (TD3), and Soft Actor-Critic (SAC), are evaluated in a continuous control environment under varying signal-to-noise ratio (SNR) conditions ranging from 5 dB to noise-free conditions. Results demonstrate that TD3 achieves the most stable learning performance, obtaining a mean reward of −354.24 under noise-free conditions, while DDPG provides the highest joint-angle tracking accuracy with an RMSE of 0.0369 rad. SAC exhibits superior robustness in noisy environments, achieving the highest learning ratio of 0.51 at 5 dB SNR. Furthermore, the proposed personalised framework reduces tracking errors by up to 27% compared with non-personalised baseline approaches. The findings indicate that integrating patient-specific information with RL-based adaptive control can significantly enhance robustness, tracking performance, and personalisation in exoskeleton-assisted gait rehabilitation, providing a promising direction for future intelligent rehabilitation systems.