Author

Jan Niehues

h-index 7 View on Semantic Scholar

We have 2 of 39 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Aug 2026

From Speech to Interaction: Analyzing Multimodal Systems in Cocktail-Party Scenarios

Humans have the remarkable ability to engage in spontaneous informal conversations and selectively attend to individual speakers while filtering out competing speech from nearby conversations. This"cocktail party"scenario still presents severe challenges to speech recognition systems. The CHiME-9 MCoRec task provides a...

Thai-Binh Nguyen, Zhaolin Li, Jan Niehues et al. · 0 citations

#artificial intelligence Nov 2025

OmniFusion: Simultaneous Multilingual Multimodal Translations via Modular Fusion

An end-to-end approach that fuses MMFMs with translation LLMs, enabling joint end-to-end training and achieving a 1-second latency reduction in SimulST compared to cascaded pipelines and also improves the overall translation quality is proposed.

Sai Koneru, Matthias Huck, Jan Niehues · arXiv.org · 0 citations