Jul 2026· Signal Processing and Communications Applications Conference· pp. 1-4· 0 citations· 16 references
Abstract
This study investigates the English-to-Turkish clinical translation performance of three large language models (Aya-23, Seed-X-Instruct, Gemma-3) using zero/few-shot prompting and QLoRA fine-tuning. Our three-stage setup evaluates: (1) general translation after FLORES-devtest training, (2) medical domain adaptation on i2b2 via a mixed dataset, and (3) generalization capacity on the independent FLORES-test set after mixed-data fine-tuning, using SacreBLEU, chrF, and COMET. Results show that Seed-X-Instruct achieves the strongest fine-tuned performance, reaching 32.70 BLEU, 64.34 chrF, and 90.65 COMET on the general FLORES test set, and 22.40 BLEU, 54.61 chrF, and 79.70 COMET on the medical i2b2 set. After mixed-data training, Seed-X improves from 11.48 to 32.39 BLEU on the unseen FLORES test set, whereas Aya-23 drops from 19.23 to 10.83 and Gemma-3 largely preserves its strong zero-shot baseline. These findings indicate that QLoRA effects are model-dependent and that domain adaptation does not yield the same generalization behavior across models.
We present a systematic study of healthcare-domain cross-lingual transfer to address the scarcity of biomedical NMT resources for Arabic-script languages. We use Arabic and Persian as higher-resource pivots to improve translation for \textbf{four severely low-resource} targets: Dari (Afghan Persian, a standardised variety of Persian), Pashto, Sorani Kurdish (Central Kurdish, a major standardized variety of Kurdish), and Urdu (closely related to Hindi). Using LoRA fine-tuning on small decoder-only LLMs, we train \textit{domain-specific pivot adapters} and evaluate \textbf{three transfer strategies}: few-shot in-context learning, minimal supervised adaptation, and, to the best of our knowledge, for the first time in this setting, zero-data LoRA adapter merging. Supervised adaptation with just 500 sentences achieves near pivot-language quality for Dari (CHrF++ 41.01) and meaningful gains for Urdu (28.88), while adapter merging reaches within 3.5 CHrF++ of supervised adaptation for Dari at zero additional cost. Pashto and Sorani Kurdish remain insufficient for high-stakes clinical deployment exposing the limits of cross-lingual transfer when structural distance from the pivots is too great. LoRA adapter merging works surprisingly well for closely related languages, even without target-language biomedical data.
Abdullah Alabdullah, A. Eslamighayour, Sarp Harbalioglu et al.· 0 citations
In this paper, we address Task 1 on adverse drug event (ADE) detection and Task 8 on Mul-tiClinNER at SMM4H-HeaRD 2026. ADE detection is formulated as a multilingual binary classification problem over social media posts spanning German, French, Russian, English, Mandarin and Japanese, with zero-shot on Farsi. Using XLM-RoBERTa-Large with a dual-pooling head, combined with stratified sampling, language-conditioned inputs, translation-based augmentation, and calibrated ensembling, our model achieves a macro F1 score of 0.6088, surpassing both the competition mean (0.5465) and median (0.5798). Our work in MultiClinNER targets clinical NER for English text. Using GLiNER-large with sliding-window inference, query augmentation, and calibrated thresholds, it achieves strict F1 scores of 0.7591 (Disease), 0.7263 (Procedure), and 0.6733 (Symptom), outperforming a Pub-MedBERT baseline across all entities.
Nirjhar Das, Rathijit Aich, Mahfuzulhoq Chowdhury· Proceedings of the 11th Soci...· 1 citation
General-purpose large language models (LLMs) may struggle in specialised machine translation, but the conditions under which fine-tuning improves translation performance remain unclear. This study compares full-parameter fine-tuning (FPFT) and parameter-efficient fine-tuning (PEFT) for Chinese-English political discourse translation using a purpose-built corpus and the Qwen3-14B model. Translation performance was assessed on three 50-item test sets using BLEU, ROUGE-L F1, METEOR, and BERTScore F1, together with BLEU pass-rate likelihood-ratio G2 tests, paired t-tests, and paired Cohen’s dz for item-level score differences. The results reveal a clear contrast between unseen in-domain evaluation, maximum-overlap benchmarking, and semantically related but non-fine-tuned evaluation. On Test Set A and Test Set C, neither fine-tuning strategy produced a statistically significant BLEU pass-rate advantage over the base model, and paired tests across the continuous metrics did not show consistent fine-tuning gains. On Test Set B, which was sampled from the fine-tuning corpus, both fine-tuned models substantially outperformed the base model across all four metrics, with FPFT achieving the highest scores and PEFT providing a more computationally efficient alternative. These findings indicate that textual overlap between training and deployment data, rather than broad domain similarity alone, strongly conditions the observed benefit of fine-tuning. The study offers an empirically grounded framework for selecting fine-tuning strategies in specialised machine translation.
It is shown that mechanistic diagnosis can serve as a practical guide for targeted adaptation in underrepresented-language medical LLMs, and Targeted Low-Rank Adaptation (TLoRA) is proposed, restricted to the layer window where cross-lingual representations diverge, upstream of the output layers where the failure manifests.
Chaimae Abouzahir, Musa Khan, Hala Ali-Hassan et al.· 0 citations
An engineering-oriented, end-to-end roadmap that structures the full lifecycle of clinical language model systems—from model design and domain adaptation to optimization and real-world evaluation is introduced.
Across medical benchmarks, MedLLM shows a pattern visible only at sub-billion scale: medical competence does not degrade uniformly under compression but splits by task type and dissociation is masked at 7B, where both capabilities are present, and surfaces only when capacity is scarce.
M. R. Rahman, Asim Ahmed, Mihan Mohagheghzadeh et al.· 0 citations