Skip to content

: Can We Trust GenAI Recommendations? Unpacking Adversarial Vulnerabilities in LLM/VLM Ranking Systems

TL;DR

This talk presents a comprehensive analysis of vulnerabilities in modern generative rankers, ranging from atomic attacks to ecosystem-level dynamics, and model the search ecosystem as a game-theoretic dilemma, revealing a "Paradox of Defense" where standard countermeasures may inadvertently incentivize an arms race between attackers and search engines.

View source

Similar papers

Jul 2026

On-Policy Distillation for LLM Safety: A Routing Approach to Template-Robust Realignment

This work proposes Routing-based On-Policy Distillation (ROPD), a novel realignment framework that models the divergence between aligned and compromised output probability distributions rather than fitting specific prompt templates, establishing a new standard for robust LLM realignment.

Yong-Jian Guo, Wanlun Ma, Lingyu Shen et al. · 0 citations
Conference Open access 2026

Large Language Model Vulnerabilities

: Large language models are increasingly being deployed in safety-critical domains, yet remain vulnerable to jailbreak attacks that circumvent safety alignments. This systematic review synthesizes empirical jailbreak research published between 2024 and 2025, using a PRISMA-guided search protocol, followed by BERTopic-b...

Meda Račaitytė, Hélder Bastos, R. Ribeiro et al. · 0 citations
#natural language process... Preprint Sep 2026

VerTox: Verifiable Reward-Guided Corpus Poisoning Against Neural Ranking Models

This work proposes VerTox, the first framework to formulate corpus poisoning as a verifiable reward-guided reinforcement learning (RLVR) problem, and produces adversarial documents that frequently rank higher than target documents across major neural ranking architectures, as well as a proprietary commercial embedding...

Zhi-Qi Huang, Vivek Datla, Zhichao Xu et al. · 0 citations
Preprint Aug 2026

Beyond Over-Refusal: Defending Indirect Prompt Injection via Latent Instruction Manifolds

AEGIS (Adaptive Ensemble Guard for Injection Shielding) extracts instruction-sensitive projectors to identify malicious instructions and leverages a Unified Multi-Layer Consensus mechanism that aggregates topologically distinct signals across the network depth.

Jia-Hao Chen, Ruiping Yin, Xin-Feng Li et al. · 1 citation · ⚡1
Jul 2026

TriShield: Zero-Utility-Loss Defense Against Privacy Backdoors in Federated Language Model Fine-Tuning via Orthogonal Gradient Projection and Optimizer State Entanglement

TriShield is presented, a three-layer deterministic defense that completely prevents NeuroImprint-style reconstruction with zero model utility loss and no additional communication rounds, and it is proved theoretically that after Layers 2 and 3, the mutual information between the uploaded gradient and any individual tr...

Chenghui Wei · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.