This work evaluates state-of-the-art LLMs as pointwise and pairwise judges of conversational success on CANDOR, finding pointwise scoring correlates moderately with human ratings, while pairwise comparison suffers from long transcripts and positional bias.
Maike Zufle, Patrícia Schmidtová, Vilém Zouhar et al.· 0 citations
A lightweight backchannel head is introduced that predicts, from a full-duplex model's own hidden states, when a backchannel should begin, and once this probability crosses a tunable threshold, a backchannel is force-decoded.
Maike Zufle, Peter Polák, Sefik Emre Eskimez et al.· 0 citations
A technique is proposed to automatically construct benchmarks of such attacks and apply it to measure leakage rates across two customisation mechanisms, prompting and fine-tuning, finding that fine-tuning without context prompts offers the best balance.
It is argued that progress requires dedicated speech-specific training data and models that genuinely condition on speech, and both text- and speech-based quality estimation metrics on two contrastive datasets targeting gender agreement and prosody fall short.
Maike Zufle, Danni Liu, Vilém Zouhar et al.· arXiv.org· 1 citation
KIT's main contribution is a scalable data augmentation pipeline that unifies heterogeneous medical dialogue datasets through synthetic speech generation and automatically generated SOAP supervision, enabling robust adaptation of a speech foundation model for end-to-end speech-to-SOAP generation.
E. Ugan, Fabian Retkowski, Yuka Ko et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.