This work finds that the wording of the question affects VLMs in two opposite ways: verbose paraphrasing reduces drift variance by 70--81% on the 8B models and the practical recipe---pad the prompt---further yields measurable gains in accuracy, even under image corruption.
Farooq Ahmad Wani, Maria Sofia Bucarelli, Mujtaba Hussain Mirza et al.· 0 citations
A representation-aware and frequency-aware evaluation framework that measures internal embedding drift, spectral sensitivity, and structural smoothness (spatial consistency of vision tokens), alongside standard label-based metrics is introduced.
Farooq Ahmad Wani, Alessandro Suglia, Rohit Saxena et al.· arXiv.org· 2 citations
This work introduces QUORUM (QUality-Optimized Routing Using Multiple annotators), a budget-aware routing framework that dynamically assigns each instance to human or LLM annotators under a fixed annotation budget and supports multiple annotations per instance, combining them through agreement-based rewards to improve...
Antonio Purificato, Maria Sofia Bucarelli, Andrea Bacciu et al.· 1 citation
This work formalizes Active Testing in NLP and conducts an extensive benchmarking of existing approaches across 18 datasets and 4 embedding strategies spanning 4 different NLP tasks, revealing variations in method effectiveness across different data characteristics and task types.
Antonio Purificato, Maria Sofia Bucarelli, Andrea Bacciu et al.· arXiv.org· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.