RCTs & Human Uplift Studies: Methodological Challenges and Practical Solutions for Frontier AI Evaluation
Human uplift studies, or studies that measure the effects of AI access on human performance via randomized controlled trials (RCTs) or similar methodologies, increasingly inform frontier AI governance and deployment decisions. While RCT methods are robust in other fields, their interaction with the distinctive properti...
Patricia Paskov, Kevin Wei, Shen Zhou Hong et al.
· Proceedings of the AAAI/ACM... · 0 citations