An overview of the ImageEval 2026 shared task on culturally grounded Arabic multimodal evaluation is presented, covering spoken visual question answering and image-grounded hallucination detection in English and Modern Standard Arabic, and CRAI-Bench, evaluating the cultural accuracy of text-to-image generation.
CARVE is introduced, a black-box counterfactual probe that compares answer changes under matched SHAM and DESTROY replays, and shows only a weak association with annotated temporal coverage, so CARVE is best understood as a routing signal rather than a direct grounding classifier.
Rama Y. AlHamidi, Rasul Khanbayov, E. Serpedin et al.· 0 citations
C COVER changes the output object: a post-hoc, model-agnostic wrapper that turns any grounder, a trained localizer or a black-box video--language model, into one that emits a temporal region containing the true moment with probability at least $1-\alpha$, by calibrating the quantile of a temporal nonconformity score on...
Aseel A. Mohamed, Rasul Khanbayov, E. Serpedin et al.· 0 citations
This work shows that deterministic, database-grounded verification catches and repairs errors selectively, and that the binding constraint is detection rather than repair, and that the binding constraint is detection rather than repair.
Can Polat, Mustafa Kurban, E. Serpedin et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.