Jared Kaplan

Challenging Quadratic Attention - A Holistic View On the Rise of Alternative Language Model Architectures

The Dialect Tax: Dialectal Biases Persist throughout the Language Modeling Pipeline

Systematic dialectal performance gaps in language models (LMs) are well documented, but the source of these disparities within the modern language modeling pipeline remains unclear. Our study traces this"dialect tax"across the natural language processing pipeline. Using parallel English dialect corpora that hold meanin...

Jailbreaking Jailbreaks: A Proactive Defense for LLMs

P RO A CT represents an orthogonal defense strategy that serves as an additional guardrail to enhance LLM safety against the most effective attacks.

Code Monitor Red Teaming for Public-Test-Passing Code

This work introduces Code Monitor Red Teaming, a monitor-red-teaming protocol that fixes a public-check information boundary while varying generator pressure, verifier scaffolding, and weak-to-strong capability.