Skip to content
Conference

A Survey of Fuzzing Techniques for Large Language Model Agents: Challenges, Methods, and Future Directions

Jul 2026 · 2026 IEEE 9th International Conference on Big Data and Artificial Intelligence (BDAI) · pp. 181-186 · 0 citations · 10 references

Abstract

With the rapid development of large language models (LLMs), LLM-based agents are evolving from single-turn text generators into autonomous decision-making systems capable of task planning, tool invocation, memory retrieval, and environmental interaction. However, the openness of agent environments and the nondeterminism of model-driven decision logic introduce security and reliability risks that are difficult to capture with conventional software testing. Fuzzing, as an automated and scalable vulnerability discovery technique, provides a promising approach for assessing the robustness of LLM agent systems. This paper presents a systematic survey of fuzzing techniques for LLM agents. First, we analyze the distinctive architecture of LLM agents and summarize three representative threat categories: indirect prompt injection, planning hallucination, and tool abuse. Second, we review existing fuzzing methods from three perspectives: test-case generation and mutation, environment simulation and interaction monitoring, and test-oracle construction. Particular attention is paid to LLM-enhanced fuzzers that exploit the semantic understanding and generation capabilities of LLMs to improve mutation quality and attack effectiveness. Finally, we connect the main technical challenges with an actionable research roadmap, including semantic coverage, cost-aware execution, reproducible oracles, multi-agent fuzzing, gray-box guidance, and automated repair.

View source

Similar papers

Open access Jul 2026

TRACER-AI: A Multi-Layer Explainable Framework for Prompt Injection, Agent Goal Hijacking, and Tool Misuse Detection in Agentic AI Systems

The results support the central hypothesis that agent security benefits from multiple independent checkpoints spanning instruction intake, goal continuity, and execution-time tool authorization.

Pallavi Singh, Khushboo Gupta, Pratibha Singh · 0 citations
Preprint Aug 2026

Tangent: An Empirical Study of Testing Practices for LLM-Based Agent Applications

This paper constructs a large-scale dataset of agent applications, tools, and tests, and manually label 2,572 test methods from 240 modules, and derives a taxonomy of 23 testing patterns across test fixtures, data, objectives, and assertions, and characterize tests by level.

Rangeet Pan, Tyler Stennett, D. Sankar et al. · 1 citation
#machine learning Review Open access 2025

Automated Vulnerability Patching in Legacy Code Using LLMs and Multi-AI Agents

While multi-agent LLM pipelines show real promise for legacy code specifically, since their capacity for autonomous context reconstruction and iterative, feedback-driven refinement directly addresses the sparse documentation and thin test coverage that define legacy environments, the literature to date has been validat...

Harsh Verma · 0 citations
Jul 2026

Tool Specifications Matter: Uncovering and Mitigating Safety Risks in AI Agents

This paper proposes SafeKeep, an inference-time safeguard that decouples safety judgment from tool execution: it assesses requests using flattened textual tool specifications while retaining the original schema-formatted specifications for execution.

Minghui Pan, Jiayuxuan Yang, Yuan-Yuan Yuan et al. · 0 citations
Conference Jul 2026

Metamorphic Testing of Multi-Agent LLM Systems: A Trace-Based Behavioral Oracle Framework

Multi-agent systems built on large language models (LLMs) are increasingly deployed for complex tasks requiring autonomous planning, tool use, and inter-agent coordination. However, the non-deterministic nature of LLM outputs and the emergent behavior arising from agent interactions render traditional test oracles inef...

Gopalakrishnan Marimuthu · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.