MaCoPlanner is presented, a task-planning framework built on knowledge compiled from equipment manuals that converts equipment manuals into a typed intermediate representation, retrieves task- and state-relevant evidence, and uses it to support plan generation.
Abstract
Robotic industrial panel operation requires not only accurate control localization but also compliance with operating procedures, safety rules, and device-state constraints distributed across heterogeneous manuals. This study presents MaCoPlanner, a task-planning framework built on knowledge compiled from equipment manuals that converts equipment manuals into a typed intermediate representation, retrieves task- and state-relevant evidence, and uses it to support plan generation. Before actuation, candidate plans are symbolically rolled out and checked against procedural and state-transition constraints; detected violations are localized and returned for targeted repair, while unresolved plans are rejected. A separate execution interface grounds verified symbolic actions to physical controls and updates the device state. Under an independent evaluation oracle, MaCoPlanner achieves a final violation rate of 2.7%, and 26.3% of the runs in the repair analysis are rejected after exhausting the refinement budget. Compared with Raw-Manual, task success increases from 62.8% to 84.4% on Level-2 tasks and from 25.9% to 43.2% on Level-3 tasks. Experiments on a controller-panel simulator without an attached industrial load further demonstrate integrated execution feasibility under representative interaction conditions, without claiming industrial deployment readiness.
PanelShield is a verifiable closed-loop safety planning framework for manual-guided industrial panel operation that balances flexibility, safety, and auditability and improves complex safety-constrained task performance over foundation-model-only planning baselines.
Gui-Peng Xin, Jia-He Xu, Chenhui Wan et al.· 0 citations
Foundation-model policies for robotic manipulation are advancing rapidly on task success, but rigorous evaluation of whether they succeed safely is still lacking. We introduce ManiGuard, a specification-grounded framework for evaluating and improving the safety of foundation-model manipulation, comprising the ManiGuard...
Yi Peng, Philip Wang, Simon Sinong Zhan et al.· 2 citations· ⚡1
Dynamic unmanned aerial vehicle (UAV) missions require online adaptation not only to geometric changes but also to evolving task-level constraints, such as energy depletion, facility unavailability, and newly imposed visits. This paper presents an event-driven hierarchical planning framework that integrates large langu...
Lu-Wei Liao, Hong-Zong Li, Li Zhang et al.· International Conference on...· 0 citations
CoMuRoS enables runtime, event-driven replanning on physical robots and supports flexible multi-robot and human-robot collaboration across diverse scenarios.
Suraj S. Borate, Bhavish Rai B, Vipul Pardeshi et al.· Frontiers in Robotics and AI· 0 citations
The value of execution-improved software as a resource for acquiring new policies in this setting is demonstrated, although initial references remain better on two target tasks when averaged across runs.
This work formalizes the reasoning-execution boundary as a typed contract and constrains language-level decisions through schema-validated tool calls defined by the Model Context Protocol, rejecting malformed commands before they reach the robot.
Wen-Hao Hong, Lan Wei, Dan-Dan Zhang· 1 citation
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduJul 30, 2026
From feet to fingertips — we are teaching robots intelligent whole-body control, fine dexterity, and teamwork to complete a broad range of complex tasks.
MIT News · Artificial Intelligence· news.mit.eduOct 13, 2026
Machine-learning networks can learn without detailed instructions from a designer. Those that do may offer insight into how the brain reorganizes itself during learning.