The extended DRLCC framework can support robustness-aware humanoid robot team scheduling in autonomous manufacturing environments where digital twin observations are delayed or uncertain, and overall task-completion performance remains stable under imperfect digital twin feedback.
Abstract
Humanoid robots are emerging as flexible robotic resources for autonomous manufacturing systems, where different types of tasks must be assigned to suitable robots while shared production resources are coordinated effectively. However, realistic manufacturing environments involve dynamic task arrivals, event-driven priority changes, heterogeneous robot capabilities, and shared-resource contention. In addition, digital twin-based scheduling may rely on state information that is delayed or uncertain, which can reduce the reliability of scheduling decisions. To address this issue, this paper extends the previously proposed deep reinforcement learning-based concurrency control (DRLCC) framework for robustness-aware scheduling and shared-resource control of a multi-functional humanoid robot team. The extended framework integrates capability-aware task assignment, feasibility-based action masking, and priority ceiling protocol (PCP)-based shared-resource coordination under delayed and uncertain digital twin observations. The framework is evaluated in a humanoid-based autonomous manufacturing scenario using performance indicators including task completion, urgent-task delay, resource contention, humanoid utilization, and robustness degradation under imperfect state feedback. Compared with the greedy ceiling-based baseline, DRLCC reduces high-priority task delay by approximately 10.9%, priority inversions by 42.1%, average waiting time by 73.8%, average block count by 74.0%, and temporary infeasible events by 73.5%, while maintaining comparable humanoid utilization. The robustness analysis further shows that overall task-completion performance remains stable under imperfect digital twin feedback, although coordination-level metrics are more sensitive to observation uncertainty and delay. These results suggest that the extended DRLCC framework can support robustness-aware humanoid robot team scheduling in autonomous manufacturing environments where digital twin observations are delayed or uncertain.
CoMuRoS enables runtime, event-driven replanning on physical robots and supports flexible multi-robot and human-robot collaboration across diverse scenarios.
Suraj S. Borate, Bhavish Rai B, Vipul Pardeshi et al.· Frontiers in Robotics and AI· 0 citations
A robust coupled cognitive - physical shared-control framework for human - robot collaboration that guarantees forward invariance of the safe set and bounded closed-loop signals is proposed.
Ya-Na Yang, Zhijia Li, Huixin Jiang et al.· Intelligence & Robotics· 0 citations
The findings demonstrate the limitations of the current heuristic integration and support further research on dynamic task assignment, controlled component evaluation, stronger collision-avoidance mechanisms, learned communication, and end-to-end MARL training.
B. Kyiewu, Clinton Amponsah, Linda Bessa-Simons et al.· Discover Robotics· 0 citations
AssemblyGrid v1 is introduced, a reproducible benchmark for repeated multi-robot production that combines explicit process progression, decentralized observations, material transfer, temporary multi-robot coalitions, productive concurrency, and geometry-dependent feasibility within one task-level formulation.
Fouad Bahrpeyma, David Heik, Dirk Reichelt· 0 citations
A neural scheduling framework for distributed multi-robot task allocation, consisting of a multi-decoder graph attention model (MDGAM) policy model and a critic-free group relative multi-agent policy gradient (GRMAPG) training algorithm, which improves task-completion performance over existing heuristic and learning-ba...
A deep analysis of MARL applied to industrial multi-robot systems based on a systematic review is presented, with particular focus on cooperative manipulation tasks.
Francisco J. Huertos, Oihane Bañales, Pedro Álvarez et al.· Robotics· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.