Calibrated, Order-aware Detection KWS (CORD-KWS), a training framework that introduces two complementary objectives while retaining the same encoders, cosine scoring, and O(1) keyword enrollment: a calibrated detection head that supervises absolute scores, and a frame-level CTC objective that preserves phonetic order information.
Abstract
Open-vocabulary keyword spotting (KWS) must detect arbitrary keywords without retraining. Cross-attention-based models achieve state-of-the-art performance but require pairwise interaction between the audio and each keyword, recomputing the fused representation for every audio--keyword pair. Embedding-based models avoid this computational cost through independent encoding and similarity scoring, yet remain inferior on challenging benchmarks such as LibriPhrase-hard. We show that this gap is primarily a training issue rather than a limitation of model capacity. While contrastive learning encourages correct keywords to rank above negatives, it does not explicitly calibrate absolute similarity scores, which are critical for applying a fixed threshold across keyword detection. We propose Calibrated, Order-aware Detection KWS (CORD-KWS), a training framework that introduces two complementary objectives while retaining the same encoders, cosine scoring, and O(1) keyword enrollment: a calibrated detection head that supervises absolute scores, and a frame-level CTC objective that preserves phonetic order information. CORD-KWS achieves EERs of 0.43% and 9.64% on LibriPhrase-easy and LibriPhrase-hard, respectively, outperforming existing embedding- and cross-attention-based models.
Accurate page transcription remains difficult for vision language models under limited input and training budgets. We present SP-DocReader, a self-play framework for optical character recognition (OCR) that targets residual errors after supervised fine-tuning. Reading Discrepancy Masking aligns reference and generated...
Wen-Jie Liao, Xiao-Hui Song, Liang Zhao et al.· 0 citations
By jointly optimizing distillation and quantization within a unified teacher-anchored framework, this method ensures consistent training under quantization, suppressing hard negatives and enlarging decision margins, and designs a lightweight cross-attention adapter that enhances non-RGB representations through RGB-guid...
Jinwoo Jeon, GyuYeop Do, Yunkyu Lim et al.· 0 citations
Visual speech promises noise-robust keyword spotting, yet a visual stream is not necessarily used. On a tri-modal query-by-example keyword spotting (QbyE-KWS) benchmark, we find that a system with a task-trained visual encoder comes within 2 percentage points of a text-and-audio system in equal error rate (EER) at -10...
Ming-Hsiang Hu, Kuan-Tang Huang, Hung-Shin Lee et al.· 0 citations
Open-vocabulary audio-visual event localization (OV-AVEL) grounds a text-queried event in time from video, audio, and language, with a reliability-aware asymmetric distillation framework.
The finding is that unified OVD can be made substantially simpler with semantic-rich visual representations and scalable grounding supervision, and turns mixed prompting from interference into complementarity, improving over text or visual prompt alone.
Xiao-Yan Wei, Zhi-Min Yao, Rui-Lin Yang et al.· arXiv.org· 0 citations
CircleMatch is presented, a matching framework enabling KWS with very few parameters, which suggests approximate shift equivariance of prototype responses and adaptation to temporal compression.
Jia-Jun Sun, Zhe Gao· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.