Jailbreaks for Black-Box Uncertainty Quantification in Large Reasoning Models
While Large Reasoning Models (LRMs) excel at complex reasoning, alignment through reinforcement learning often induces systemic overconfidence. In production environments, where logits may be unavailable, robust black-box uncertainty quantification (UQ) is essential for trustworthiness and safety. Focusing on question-...
Lucas Biechy, Cédric Eichler, Adrien Boiret et al.
· 0 citations