MIKI (multi-agent integrated KUKA interface), a decoupled dual-agent framework that bridges high-level reasoning and low-level syntactic verification for industrial robot programming, is proposed.
Abstract
The integration of large language models (LLMs) into KUKA industrial robots offers a promising pathway toward intuitive natural language control and a higher level of intelligence. However, existing methods face two primary challenges: their reliance on predefined motion primitives and the syntactic fragility imposed by the strict constraints of proprietary KUKA Robot Language (KRL). To address these challenges, we propose MIKI (multi-agent integrated KUKA interface), a decoupled dual-agent framework that bridges high-level reasoning and low-level syntactic verification for industrial robot programming. The controller agent incorporates a chain-of-thought (CoT) reasoning mechanism to systematically decompose abstract human instructions into logical intermediate steps. By leveraging a visual toolchain, it translates these reasoned plans into a sequence of executable actions, each embedded with precise world coordinates. Subsequently, the code generation agent employs a syntax-guided iterative refinement process, underpinned by an ANTLR4 parser, to transform these actions into verified and executable KRL code. Experimental results demonstrate that this closed-loop approach substantially improves the syntactic success rate of code generation from 0.61 to 0.89. Furthermore, the framework achieves an average success rate of 0.6 across five desktop manipulation tasks of varying complexity using a physical KUKA robotic arm, validating its effectiveness in bridging high-level cognitive reasoning with deterministic industrial execution.
This work formalizes the reasoning-execution boundary as a typed contract and constrains language-level decisions through schema-validated tool calls defined by the Model Context Protocol, rejecting malformed commands before they reach the robot.
Recent advances in Generative Artificial Intelligence (GenAI), particularly Large Language Models (LLMs), are driving robotic architectures toward agent-based high-level orchestration, in which natural-language instructions can be translated into context-aware action sequences. While the integration of these agents and...
Jesús Moncada-Ramírez, Jose-Raul Ruiz-Sarmiento, J. González-Jiménez· 0 citations
This work proposes a hierarchical closed-loop agentic LLM-based framework to ensure robust multi-robot manipulation and achieves superior success rates, ensures robust adaptability ranging from single to cross workspace manipulation, and offers a generalizable approach for diverse manipulation tasks.
Yi-Xiang He, Lan Wei, Haoming Cen et al.· Robotics· 0 citations
Many robotic tasks are temporally extended and demand precise specifications of subgoals, constraints, and their temporal ordering. Yet human operators typically communicate such tasks in natural language, which is inherently ambiguous, underspecified, and context dependent. Translating human instructions into formal t...
Haofei Hou, Fan-Xu Meng, Shunyi Zhao et al.· 0 citations
A contract-grounded BT synthesis architecture in which a coding agent queries a robot-side Model Context Protocol (MCP) server to retrieve an explicit contract consisting of a skill library, permitted BT operators, and optional BT composition templates, before synthesizing a BT for validation and execution is proposed.
Jonathan Salfity, R. Anderson, Mitchell W. Pryor· arXiv.org· 0 citations
Multi-agent systems built on large language models (LLMs) are increasingly deployed for complex tasks requiring autonomous planning, tool use, and inter-agent coordination. However, the non-deterministic nature of LLM outputs and the emergent behavior arising from agent interactions render traditional test oracles inef...
Gopalakrishnan Marimuthu· International Conference on...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.