Conformal Privacy Auditing: Calibrated Re-identification Attacks with Statistical Guarantees
Conformal Privacy Auditing is introduced, a distribution-free calibration framework that provides a statistical certificate of re-identification risk for each released document against LLM-empowered adversaries and enables audits of open-source models and proprietary API models in a unified framework.