Tosho Hirasawa

When Modality Gap Reduction Fails: Prediction-Level Hubness in CLIP

This work provides a systematic explanation of why modality gap reduction does not consistently improve CLIP zero-shot accuracy from the perspective of downstream decision structure and suggests that gap correction should be evaluated not only by average alignment, but also by its impact on downstream prediction struct...