Skip to content

Nemotron 3.5 Content Safety Moderator: A Compact Multimodal, Multilingual, and Reasoning Enabled Content Safety Moderator

Aug 2026 · 1 citation · 34 references
Computer Science

TL;DR

Nemotron 3.5 CS demonstrates a practical coverage tradeoff: it adds image-conditioned and policy-conditioned moderation while remaining broadly competitive with specialized guard models, suggesting that compact vision-language moderators can serve as deployable front-line safety components.

Abstract

Safety moderation for deployed AI applications is moving beyond text-only prompts: systems increasingly need to judge images, documents, screenshots, and generated responses under policies that vary across domains. Existing guardrails usually cover only part of this setting, making it difficult to combine broad coverage, custom policy control, and low compute cost. We present Nemotron 3.5 Content Safety Moderator, also referred to as Nemotron 3.5 CS in this paper for brevity, a compact 4B vision-language safety moderator that jointly classifies user prompts, images, and assistant responses across 12 languages. Nemotron 3.5 CS returns safety labels for latency-sensitive moderation and can additionally produce concise reasoning traces that apply supplied custom policies and identify violated categories when reasoning is requested. We also release a multimodal and multilingual safety dataset for guard training, spanning human-labeled real-image moderation, benign vision-language and document tasks, synthetic rare-risk and jailbreak cases, and custom-policy examples. Across evaluations spanning multimodal safety, text moderation, multilingual robustness, custom-policy following, benign false positives, and latency, Nemotron 3.5 CS demonstrates a practical coverage tradeoff: it adds image-conditioned and policy-conditioned moderation while remaining broadly competitive with specialized guard models. These results suggest that compact vision-language moderators can serve as deployable front-line safety components, with reasoning used selectively for audit and policy review.

View source

Similar papers

Preprint Aug 2026

ReFrame: Evidence-Guided Test-Time Safety Alignment in Multimodal Large Language Models

ReFrame is a training-free multimodal input reframing framework where two agents share a lightweight locally deployed MLLM: the evidence-generation agent constructs complementary risk and utility evidence, and the rewrite-and-routing agent converts it into a safe proxy prompt and image-routing decision before calling t...

Wenzheng Jiang, Xuan-Kun Rong, Yuan-Zhao Zhai et al. · 0 citations
#artificial intelligence Preprint Aug 2026

SafeAtlas-VL: Beyond Binary Multimodal Safety with Large-Scale Data and Guard Models

This paper introduces SafeAtlas-VL, a dataset of 1.5M training instances that places image-, request-, and response-level judgments on a five-level ordered scale, and trains the SafeAtlas Guard series of models via target-conditioned tuning for multimodal safety detection.

Zong-Rui Wang, Xiang-Yang Zhu, Sixiang Wang et al. · 0 citations
Preprint Aug 2026

COMIC: Reference-Aware Safety Gating for Multimodal Large Language Models

It is suggested that multimodal safety cannot be enforced reliably without modeling the requested operation, the visual target to which it applies, and the confidence of that grounding.

Md Abdullahil Oaphy, Anhao Xiang, Zongxing Xie et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Transfer Safety Awareness for Cross-Modal Safety Drift in Multimodal Large Language Models

Motivated by the observation that safety signals from unsafe text processing can be transferred, safety-awareness representation transfer (SRT) is proposed, a lightweight direction-refinement method that mitigates cross-modal safety drift with a frozen MLLM backbone.

Tian-Qi Xiao, Shiyao Cui, Ming-Hao Zhang et al. · 0 citations
Open access Sep 2026

Convo-Ease: A Policy-as-Prompt Gatekeeper for Real-Time Multimodal Moderation in Enterprise Communication

Enterprise communication platforms carry text, image, and audio content across organizational contexts that public-facing moderation systems were never designed to serve. Existing moderation acts after content reaches recipients, depends on fixed harm taxonomies that cannot be updated without retraining, and rarely cov...

Soham S. Jadhav, Omkar N. Gadakh, Atharv Gaikwad et al. · 0 citations
Book Open access Oct 2026

Abstract Concept Grounding through Safety Alignment in Multimodal Large Language Models

Abstract concepts such as harmfulness, legality, privacy, and fraud present a major challenge for multimodal large language models (MLLMs), as they require reasoning across visual, linguistic, and contextual information rather than direct perception. This paper investigates three questions: whether supervised alignment...

Ying-Xu Wang, Oliver Lemon · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.