Jul 2026· 2026 IEEE 9th International Conference on Big Data and Artificial Intelligence (BDAI)· pp. 181-186· 0 citations· 10 references
Abstract
With the rapid development of large language models (LLMs), LLM-based agents are evolving from single-turn text generators into autonomous decision-making systems capable of task planning, tool invocation, memory retrieval, and environmental interaction. However, the openness of agent environments and the nondeterminism of model-driven decision logic introduce security and reliability risks that are difficult to capture with conventional software testing. Fuzzing, as an automated and scalable vulnerability discovery technique, provides a promising approach for assessing the robustness of LLM agent systems. This paper presents a systematic survey of fuzzing techniques for LLM agents. First, we analyze the distinctive architecture of LLM agents and summarize three representative threat categories: indirect prompt injection, planning hallucination, and tool abuse. Second, we review existing fuzzing methods from three perspectives: test-case generation and mutation, environment simulation and interaction monitoring, and test-oracle construction. Particular attention is paid to LLM-enhanced fuzzers that exploit the semantic understanding and generation capabilities of LLMs to improve mutation quality and attack effectiveness. Finally, we connect the main technical challenges with an actionable research roadmap, including semantic coverage, cost-aware execution, reproducible oracles, multi-agent fuzzing, gray-box guidance, and automated repair.
A four-layer taxonomy mapping 13 vulnerability types across perception, brain, action, and interaction layers is contributed, and seven open problems centered on containment are identified.
Md Jafrin Hossain, Mohammad Arif Hossain, Nirwan Ansari· 0 citations
The results support the central hypothesis that agent security benefits from multiple independent checkpoints spanning instruction intake, goal continuity, and execution-time tool authorization.
Pallavi Singh, Khushboo Gupta, Pratibha Singh· International Journal for Re...· 0 citations
This paper constructs a large-scale dataset of agent applications, tools, and tests, and manually label 2,572 test methods from 240 modules, and derives a taxonomy of 23 testing patterns across test fixtures, data, objectives, and assertions, and characterize tests by level.
Rangeet Pan, Tyler Stennett, D. Sankar et al.· 1 citation
While multi-agent LLM pipelines show real promise for legacy code specifically, since their capacity for autonomous context reconstruction and iterative, feedback-driven refinement directly addresses the sparse documentation and thin test coverage that define legacy environments, the literature to date has been validat...
Harsh Verma· International Journal of Sci...· 0 citations
This paper proposes SafeKeep, an inference-time safeguard that decouples safety judgment from tool execution: it assesses requests using flattened textual tool specifications while retaining the original schema-formatted specifications for execution.
Multi-agent systems built on large language models (LLMs) are increasingly deployed for complex tasks requiring autonomous planning, tool use, and inter-agent coordination. However, the non-deterministic nature of LLM outputs and the emergent behavior arising from agent interactions render traditional test oracles inef...
Gopalakrishnan Marimuthu· International Conference on...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.