Aug 2026· 1 citation· ⚡ 1 influential· 37 references
Computer Science
TL;DR
This work evaluates four omni LLMs in a zero-shot setting and shows that fine-tuning consistently outperforms zero-shot inference, and explores synthetic data augmentation by using an LLM to generate culturally grounded Tunisian Derja utterances, followed by voice cloning to generate synthetic speech.
Abstract
We present Aslema, our system for NADI 2026 Shared Task 5, which consists of two subtasks: intent recognition and slot filling. We evaluate four omni LLMs in a zero-shot setting and compare them with fine-tuned models. Our results show that fine-tuning consistently outperforms zero-shot inference. We further explore synthetic data augmentation by using an LLM to generate culturally grounded Tunisian Derja utterances, followed by voice cloning to generate synthetic speech. Incorporating this synthetic data improves performance on both tasks. Our final submitted system, based on Qwen3-Omni-30B and trained with a mixture of original and synthetic data, achieves 86.8% intent accuracy and 34.7 WER on the devtest split. On the official test set it ranks 1st in slot filling (59.5 CoER) and 4th among 8 teams in intent recognition (66.1% accuracy). We release our experimental scripts and will soon share the synthetic dataset to support further research in this area.
Aslema, the system for NADI 2026 Shared Task 5, which consists of two subtasks: intent recognition and slot filling and four omni LLMs in a zero-shot setting are presented and it is shown that fine-tuning consistently out-performs zero-shot inference.
Tajwaar Shafiq, Hunzalah Hassan Bhatti, S. Chowdhury et al.· 0 citations
It is found that fine-tuning is a prerequisite for these inference-time techniques: without domain adaptation, prompting and shallow fusion cause severe hallucination on air traffic control speech, suggesting that domain difficulty determines whether prompting can work without fine-tuning.
The design and launch of SnapLGR, an LLM-based generative retrieval system for short-video recommendation at Snapchat shows that successful production SnapLGR requires joint design across representation learning, vocabulary grounding, and efficient training and serving.
Liam Collins, Jiwen Ren, Donald Loveland et al.· arXiv.org· 0 citations
A unified phoneme-based TTS-to-ASR augmentation pipeline built around a multilingual TTS model trained from scratch using the F5-TTS architecture with language-ID conditioning is presented and phoneme-frequency-guided selection (PFGS) is proposed, which ranks candidate sentences using phoneme frequencies estimated from...
Zhen Wang, Tian-Rui Wu, Rong-Qi Han et al.· 0 citations
Experiments with six LLAMA and MISTRAL models show that LoRA substantially improves dialogue generation while requiring only 25-50% of the training data to recover over 90% of the final performance gains, and zero-shot evaluation with frontier LLMs shows that TalkFa remains a challenging benchmark.
Neda Jamshidi, Kamyar Zeinalipour, F. Akbari et al.· 0 citations
Results show that supervised fine-tuning provides the largest gain, while synthetic-speech LoRA adaptation and reinforcement learning further improve robustness, while synthetic-speech LoRA adaptation and reinforcement learning further improve robustness.
Hao Wu, Rong-Qi Han, Zhen Wang et al.· 0 citations