Skip to content
Open access

Generalized Process Simulation of Heterogeneous Industrial Robots Using a Shared Machine Learning Model

Jul 2026 · Journal of Machine Engineering · 0 citations · 25 references

TL;DR

Results indicate that a shared task-space learning policy combined with robot-specific inverse kinematics can support scalable robot process simulation.

Abstract

Industrial robot process simulation plays an important role in production planning, optimization, and digital twin development. However, many existing simulation approaches rely on robot-specific and manually parametrized models, which limits scalability in heterogeneous robot environments. This paper proposes a unified machine learning–based simulation framework for modelling and simulating process behaviour across different industrial robot platforms using a shared task-space learning policy. The proposed approach combines reinforcement learning and inverse kinematics with clearly separated roles. The reinforcement learning policy generates end-effector motion in task space, while inverse kinematics converts the desired motion into robot-specific joint configurations and supports geometric feasibility. This separation reduces the dependence of the learning model on the joint structure of a particular robot. Experimental evaluation on heterogeneous robot platforms showed that the proposed framework can learn accurate target-reaching behaviour in simulation. The best-performing policy achieved a success rate close to 1.0, a mean final distance error of 0.0082 m, and a mean final orientation error of 5.55°. These results indicate that a shared task-space learning policy combined with robot-specific inverse kinematics can support scalable robot process simulation.

Read PDF

Similar papers

Open access Sep 2026

A transformer-based reinforcement learning framework for autonomous training of industrial robotic manipulators

Introduction Autonomous robotic manipulation in modern manufacturing requires control policies that simultaneously achieve precision, adaptation, operational safety, and multi-task capability. Methods This paper proposes a Transformer-Based Reinforcement Learning Network (TRL-Net) that combines temporal state encoding,...

Balnur Kenjayeva, A. Galimov · 0 citations
#machine learning Preprint Sep 2026

Learning Multi-Agent Task Assignment and Navigation in the Factory: from Simulation to Real Robots

Feature-fusion Multi-Agent Proximal Policy Optimization (FMAPPO) is proposed, which fuses 2D LiDAR measurements with task-specific state information to enable safe decentralized multi-robot task assignment and navigation and demonstrates that the learned decentralized policies can coordinate multiple robots to service...

A. Abdalwhab, Giovanni Beltrame, David St-Onge · 0 citations
Conference Open access Jul 2026

Enhancing Sim2Real Transfer for Torque-Controlled Robots through Real2Sim Dynamics Estimation and Reinforcement Learning

This work proposes a Real2Sim2Real pipeline that improves Sim2Real transfer for torque-controlled robotic arms by combining trajectory matching, parameter optimization via genetic algorithms, and domain randomization, and demonstrates a significant improvement in tracking accuracy and policy robustness after parameter...

Davide Bargellini, Alex Pasquali, Andrea Govoni et al. · 0 citations
#reinforcement learning Conference Open access Sep 2026

A Review of Robot Adaptive Control Driven by Deep Reinforcement Learning

This review aims to clarify the development path of DRL-driven robot adaptive control, offering reference for theory, algorithm design, and engineering practice and it is hoped that this survey will help new researchers quickly grasp the landscape of the field.

Fu-Te Xiao · 0 citations
Preprint Sep 2026

Mobile Multi-Robot Navigation under Runtime Uncertainty via Koopman Operator Learning and Nonlinear Model Predictive Control

In this work, we developed a nonlinear model predictive control (NMPC) framework that employs learned dynamics via the Koopman Operator theory for mobile multi-robot navigation. We formulated and solved NMPC problems using a lifted bilinear Koopman-based model that accurately predicts affine input systems affected by p...

Xiao-Bin Zhang, Konstantinos Karydis · 0 citations
Open access Aug 2026

Application and evaluation of reinforcement learning for two-dimensional trajectory tracking in snake-like robots

Context—Snake-like robots are biomimetic systems that can move effectively in narrow, complex, and restricted environments thanks to their modular and flexible body structures composed of numerous serially connected joints. These characteristics offer significant advantages, particularly in areas such as pipeline inspe...

Furkan Mezgil, M. Bingöl · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.