Skip to content

Category

cybersecurity

1,407 papers

#machine learning Preprint Sep 2026

PrivCert: Certifying Statement Support under Differential Privacy

Differentially private (DP) text generation can protect individual records, but privacy alone does not specify what evidence a released statement carries about the underlying data. We identify this as an evidence gap: a private report may contain plausible claims without indicating whether they are strongly supported b...

Tsubasa Takahashi, Takumi Hiraoka · 0 citations
#machine learning Preprint Open access Oct 2026

Privacy in Personalized AI Is a System Property, Not Just a Model Property

In personalized AI applications, such as conversational assistants and recommender systems, users interact not with models in isolation but with broader systems that access, infer, and reuse user information across components and over time. While such use of user information is integral to personalization, it also rais...

Guillaume Salha-Galvan, Jiaying Xu · 0 citations
#machine learning Preprint Sep 2026

VirusCascade: Hijacking Collaborative Reflection in LLM-Powered Recommender Agents

Advancing beyond traditional static scoring models, LLM-powered agentic recommender systems (LLM-ARS) instantiate users and items as autonomous agents, whose semantic states are dynamically refined through a recurrent process known as collaborative reflection. While this mechanism improves recommendation quality, it si...

Yu-Rong Hao, Wen Zhou, Guo-Wei Guan et al. · 0 citations
#machine learning Preprint Sep 2026

Anchoring Adversarial Trajectories to Data Manifolds: A Bilevel Transfer Optimization Framework

Manifold Anchored Bilevel Transfer (MABT), a unified framework that anchors adversarial trajectories to the shared semantic subspace, is proposed, and a Hessian-free solver with linear-time complexity is developed to handle the resulting hierarchy.

Yao-Hua Liu, Yi-Fan Guo, Jia-Xin Gao · 0 citations
#machine learning Preprint Open access Oct 2026

SparLeak: Privacy Leakage from Sparse Attention in LLM Inference on Shared GPUs

Sparse attention is widely used to accelerate long-context inference in modern large language models (LLMs), but its input-dependent execution behavior introduces previously unexplored privacy risks. We identify a new GPU micro-architectural side channel, termed Sparsity-Induced Memory Access (SIMA), which arises from...

Fahao Chen, Linkang Du, Jinhao Zhou et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

The Surface You Test Is Not the Surface That Breaks

Prompt-injection benchmarks for LLM agents typically test attacks through a single injection surface and report the resulting attack success rate as a property of the model. We ask whether those robustness conclusions remain stable when the same adversarial content enters through a different part of the agent interface...

Syed Nazmus Sakib, Nafiul Haque, Shahrear Bin Amin et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

KBF: Knowledge Boundary as Fingerprint for Language Model and Black-Box API Auditing

Relay and reseller APIs mediate access to large language models (LLMs), but users cannot directly verify which model serves them. We introduce \name, a black-box auditing protocol based on stable factual recall near the knowledge boundary, including repeatable wrong answers. KBF generates benign, renewable probes and c...

Yijia Fang, Yiqing Feng, Bingyu Li et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

AI Security Research Should Better Incentivize Defense Research

This work examines an imbalance in artificial intelligence (AI) security research: the field tends to produce more work on attacking AI systems than on defending them. Drawing on related academic papers, we find biased attack-to-defense ratios across subfields, including federated learning, speech recognition, membersh...

Youqian Zhang · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Trusted Weights, Treacherous Optimizations? Optimization-Triggered Backdoor Attacks on LLMs

Inference optimization aims to minimize the latency and resource consumption of LLM inference while preserving output quality, making large-scale deployment practical and cost-effective. However, optimized execution can introduce small numerical inconsistencies from the original model. We reveal that this inconsistency...

Yifei Wang, Yida Yang, Tianlin Li et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Kill-Chain Canaries: Stage-Level Tracking of Prompt Injection Across Attack Surfaces and Five Production LLMs

Multi-agent LLM systems now read documents, web pages and tool results on behalf of users, yet their resistance to prompt injection is usually reported as one number: did the attack succeed? We introduce a kill-chain canary method that plants a unique token in every injected payload and records the furthest of four sta...

Haochuan Kevin Wang, Zechen Zhang · 0 citations
#artificial intelligence Preprint Open access Oct 2026

GraphToxin: Reconstructing Full Unlearned Graphs from Graph Unlearning

Graph unlearning (GU) has emerged as a promising solution to comply with "the right to be forgotten" regulations by enabling the removal of sensitive information upon request. However, this solution is not foolproof. The involvement of multiple parties creates new attack surfaces, and residual traces of deleted data ca...

Ying Song, Balaji Palanisamy · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

GPT-Lab Oct 30, 2026

Black October? The Week AI Changed the Cybersecurity Conversation

Critical flaws, compromised release channels and agentic AI threats landed within days of each other in mid-October 2026. Why “Black October” may say more about how well we now find weaknesses than about the attacks themselves. The post Black October? The Week AI Changed the Cybersecurity Conversation appeared first on GPT-Lab.

Google DeepMind Blog Jul 17, 2026

Introducing Gemini 3.5 Flash Cyber

Google introduces Gemini 3.5 Flash Cyber, a lightweight cybersecurity model to find and patch vulnerabilities.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.