Who Should We Listen to More? Welfare-Aware Preference Acquisition for Pluralistic Alignment
Welfare-Aware Preference Acquisition (WAPA) uses auxiliary reference models to estimate query gains and individual utilities, then selects queries by estimated marginal welfare gain while updating recipient utilities, and it is proved exact optimality of the acquisition algorithm for the estimated welfare objective und...