CRED: Calibrated Relational Enhanced Distillation for LLM-Based Pointwise Reranking
CRED (Calibrated Relational Enhanced Distillation) is proposed, which integrates Adaptive Teacher Calibration (ATC) to calibrate teacher predictions and amplify score margins, while employing Preference Relation Alignment (PRA) to align the distributional patterns of relevance score differences, enabling the student to...