Traditional retrieval-augmented generation (RAG) frameworks process documents without attending to their hierarchical structure, leading to poor performance, especially in low-resource languages such as Bengali. To address this, we propose a structure-aware RAG framework that models Bengali textbooks as hierarchical gr...
Abu Tarabin Surzo, A. K. M. Nihalul Kabir, Sm Azmain Faysal et al.· 0 citations
The stronger method is evaluated across 15 typologically diverse XL-Sum languages organised into three sets, beating the CE-only baseline on 10/15 languages; gains are most reliable where the two teachers contribute complementary signal, and weakest where they have saturated or jointly weak target-language coverage.
Dipto Sumit, Ankan Kumar Roy Srizon, Sadia Khair Rodela et al.· arXiv.org· 0 citations
On a 740-instance healthcare API routing task with a 1.5B Qwen student and a 20B teacher, eight KD variants are compared against supervised cross-entropy, finding single-seed evaluation is unable to detect central failure modes in small-model KD.
Dipto Sumit, Sakib Ul Haque, Farig Sadeque· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.