Skip to content

LLM performance on multi-interlocutor NLI tasks

Unknown authors
· 0 citations · 8 references

TL;DR

It is concluded that genuine multi-speaker dialogue inference remains an unsolved problem for current LLMs under standard prompting strategies.

View source

Similar papers

TalkFa: A Unified Benchmark for Farsi Dialogue Generation and Understanding

Experiments with six LLAMA and MISTRAL models show that LoRA substantially improves dialogue generation while requiring only 25-50% of the training data to recover over 90% of the final performance gains, and zero-shot evaluation with frontier LLMs shows that TalkFa remains a challenging benchmark.

Neda Jamshidi, Kamyar Zeinalipour, F. Akbari et al. · 0 citations

Probing cross-lingual differences in how LLMs represent Natural Language Inference

Cross-lingual probe transfer and direct comparison of probe weights show that NLI representations are most alignable in the middle layers: probes transfer best there, and probes trained independently on different languages converge to similar weight vectors, peaking mid-network.

Nicolas Ramos Fernandez · 0 citations
#natural language process... Preprint Sep 2026

TRILOGUE: A Trilingual Spoken Dialogue Fact-Checking Benchmark with Evidence and Paired Audio

TRILOGUE (TRIlingual spoken diaLOGUE fact-checking) is introduced, a large-scale trilingual benchmark of source-grounded spoken dialogues in English, Russian, and Kazakh that supports claim check-worthiness detection, source-article evidence retrieval, and claim verification with claim-only, gold-evidence, and retrieve...

Chaewan Chun, Meruyert Aristombayeva, Jiyoung Choi et al. · 0 citations
Jul 2026

MEUSLI: a Multilingual Projector for LLM-based ASR and Beyond

MEUSLI is introduced, the first open-science multilingual projector family that links a Whisper encoder with open-source multilingual LLMs, enabling fully open-source end-to-end ASR in 28 European languages.

Lorenzo Concina, Seraphina Fong, M. Matassoni et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.