A three-stage training pipeline for developing compact and efficient retrievers that remain competitive with substantially larger models, which requires no original ground-truth relevance labels and relies exclusively on supervision generated by strong embedding models and rerankers utilised as teachers.
Slawomir Dadas, Rafal Poswiata, Malgorzata Grebowiec et al.· 0 citations
Polish ModernBERT, a family of four Polish encoders available at Base and Large scales, each with 512-token and 8K context variants, achieves the best overall performance and achieves the best result on a Polish retrieval benchmark among the evaluated encoders below 300M parameters.
Michał Perełkiewicz, Slawomir Dadas, Rafal Poswiata et al.· 0 citations
PUMA (Polish Unified Multimodal Assessment) is proposed, a novel benchmark of 900 hand-crafted tasks designed to probe the limits of multimodal models in the Polish cultural and linguistic context and open-source the evaluation framework to advance localized multimodal AI research.
Slawomir Dadas, Michał Perełkiewicz, Rafal Poswiata et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.