Turning Speech Language Models into Multilingual Listeners
MULTISPEECHQA, a large-scale, synthetically generated and human-verified dataset comprising 9200 hours of 10.8 million spoken question-answer pairs in 23 typologically diverse languages, is presented and shows that high-quality synthetic datasets offer a cheap solution to improving the multilingual capabilities of SLMs...