Evil-AI Benchmark: An Evaluation Framework for Adversarial Security Assessment of LLM Agents in Smart Environments
Evil-AI Benchmark is introduced, an open-source evaluation framework for assessing LLM agents in smart environments through five adversarial threat vectors—prompt injection, persuasion, attacker-in-the-middle (AITM) simulation, data leakage, and unsafe actions—and a capability validation that checks whether a model can...