Joint Text-Audio Alignment for EEG-to-Text Decoding in Chinese Speech Production and Perception
EEAlign is introduced, a novel parameter-efficient framework that jointly aligns EEG with two axes---text alignment with BGE-M3 text embeddings and audio alignment with wav2vec~2.0 speech features via contrastive learning followed by CTC character-sequence decoding.