Using Weighted Loss in Bilingual Model Training
Large Language Models (LLMs) have achieved remarkable performance largely due to the availability of high-quality and large-scale training data. However, this reliance creates a significant performance disparity between high-resource languages such as English and low-resource languages like Arabic. The imbalance in dat...