#natural language process...
Jul 2026
Rating the Pitch, Not the Product: User Evaluations of LLMs Reflect Expectations More Than Performance
After interaction, users are still rating the pitch, not the product: user-elicited LLM evaluations, including the preference data driving public leaderboards, measure expectation management at least as much as the model itself.
Robert D. Morabito, Tyler McDonald, C. Viswanath et al.
· arXiv.org · 0 citations