Ze-Yang Zhang

Hierarchical Quantized Cross-modal Masked Autoencoders for Audio-Visual Emotion Recognition

Cross-modal self-supervised learning has shown strong potential for learning representations for audio-visual emotion recognition (AVER). However, most existing methods operate entirely in continuous embedding spaces, which can inadvertently preserve irrelevant patterns, spurious correlations, and modality-specific noi...