Skip to content

CamoDocs: A Poisoning Attack Against Retrieval-Augmented Language Models Using Camouflaged Documents

Jaewon Jung Haizhong Zheng Hongsun Jang Jaeyong Song Beidi Chen Jinho Lee
Aug 2026
Natural Language Processing Cybersecurity

Abstract

Retrieval-augmented generation (RAG) augments LLMs with external documents, but public or user-editable sources expose RAG systems to data poisoning: attackers can inject malicious documents to steer outputs toward targeted answers. Existing poisoning attacks often rely on query inclusion, inserting the target query into poisoned documents to improve retrieval; however, this creates lexical and embedding-space artifacts that make them easy to filter. We propose CamoDocs, a poisoning attack that avoids direct query inclusion by camouflaging adversarial documents among benign content. CamoDocs chunks synthesized benign and adversarial drafts, replaces selected tokens in benign chunks with dispersion tokens that spread poisoned-document embeddings, and applies coherence filtering to limit readability degradation. Across seven RAG defenses, three open-weight LLMs, and three benchmarks, CamoDocs achieves strong average ASR while avoiding query-overlap artifacts exploited by simple query detection. It also remains effective against proprietary models, achieving average ASRs of 61.80% on GPT-5.4-mini and 55.09% on Claude-Haiku-4.5. Finally, we show that erasure-heavy clustering defenses such as TrustRAG can reduce ASR, but only with substantial utility drops on retrieval-dependent benchmarks such as NeoQA. Code is available at https://github.com/jaewonalive/CamoDocs.

View source

Similar papers

#artificial intelligence Preprint Feb 2025

`From Prompt to Perturbation': An Adaptive Framework for Voice-Based Jailbreaks on Audio LLMs

An adaptive jailbreak attack framework for systematic evaluation of both cascaded pipelines and end-to-end large audio-language models under a unified experimental setting that achieves consistently higher attack success rates across diverse audio-based LLM systems.

Linghan Huang, Bo Li, Huaming Chen et al. · 12 citations · ⚡2

Jailbreaking in the Haystack

NINJA (short for Needle-in-haystack jailbreak attack), a method that jailbreaks aligned LMs by appending benign, model-generated content to harmful user goals to reveal fundamental vulnerabilities in modern LMs.

R. Shah, C. Wu, Shashwat Saxena et al. · 4 citations

Convergent Evolution: How Different Language Models Learn Similar Number Representations

This paper identifies two different routes through which models can acquire geometrically separable features: they can learn them from complementary co-occurrence signals in general language data, including text-number co-occurrence and cross-number interaction, or from multi-token addition problems.

Deqing Fu, Tianyi Zhou, Mikhail Belkin et al. · 3 citations

SimulRAG: Simulator-based RAG for Grounding LLMs in Long-form Scientific QA

SimulRAG, a simulator-based RAG framework with a generalized retrieval interface that translates between text and simulator parameters/outputs, is proposed, which improves informativeness and factuality over the strongest adapted RAG baselines, while UE+SBA enhances claim-level efficiency and quality.

Haozhou Xu, D. Wu, M. Chinazzi et al. · 3 citations
#artificial intelligence Open access Jun 2026

NE-BERT: A Multilingual Language Model for Nine Northeast Indian Languages

NE-BERT, a domain-specific multilingual encoder model trained on approximately 8.3 million sentences spanning 9 Northeast Indian languages and 2 anchor languages, addresses critical vocabulary fragmentation issues in extremely low-resource languages such as Pnar and Kokborok through aggressive upsampling strategies.

Badal Nyalang · 2 citations

Making Implicit Premises Explicit in Logical Understanding of Enthymemes

A pipeline that integrates a large language model to generate intermediate implicit premises based on the explicit premise and claim, a neuro-symbolic reasoner based on a SAT solver to determine entailment, and a neuro-symbolic reasoner based on a SAT solver to determine entailment is proposed.

Xuyao Feng, Anthony Hunter · 2 citations

Related blog posts

MIT News · Artificial Intelligence Aug 27, 2026

Looking beyond natural sequences

A new machine-learning framework aims to improve the success rate of computational protein design while moving away from results that reproduce sequences found in nature.