Skip to content
Preprint

MELON: A Large-Scale Dataset for Multi-Event Text-to-Long-Video Retrieval

Aug 2026 · 0 citations · 46 references
Computer Science

TL;DR

MELON is introduced, the first large-scale dataset designed to extend text-video retrieval to long-form videos featuring complex, multi-event structures, and a multi-event aware loss is proposed that encourages models to differentiate between full-event and partial-event matches, yielding substantial improvements in retrieval accuracy.

Abstract

Existing text-video retrieval datasets primarily consist of short-form clips containing a single dominant event. While suitable for measuring basic vision-language alignment, they are limited in capturing real-world retrieval scenarios, where long-form videos naturally contain multiple semantically distinct events and a single text query may correspond to several non-contiguous temporal segments. To bridge this gap, we introduce MELON, the first large-scale dataset designed to extend text-video retrieval to long-form videos featuring complex, multi-event structures. MELON explicitly annotates multiple event intervals per video along with their corresponding textual descriptions, enabling both training and evaluation of multi-event understanding in long, untrimmed videos. In addition, we propose a multi-event aware loss that encourages models to differentiate between full-event and partial-event matches, yielding substantial improvements in retrieval accuracy. Together, the MELON dataset and our proposed loss establish a robust foundation for expanding text-to-video retrieval to complex long-form scenarios and provide a more realistic evaluation setting for future research in the field.

View source

Similar papers

Preprint Oct 2026

EC-RAG: Event Chain Retrieval-Augmented Generation for Long Video Understanding

Current large video-language models (LVLMs) still face challenges when dealing with long videos, mainly because frames are often processed independently, making it difficult to capture temporal dependencies across events. Although retrieval-augmented approaches have been introduced to provide additional context, most o...

Yu-Hao Qin, Jun-Bo Wang, Yu-Ke Li et al. · 0 citations
Preprint Sep 2026

MARS: What Retrieval Signals Are Hidden in Multimodal Large Language Models for Text-Video Retrieval?

Experiments on four text-video retrieval benchmarks show that MARS achieves state-of-the-art results in both direct similarity-based retrieval and reranking settings, and a hard-negative-aware slot specialization objective that encourages the slots to capture discriminative matching cues is introduced.

Uicheol Jung, Juyoung Hong, Geuntaek Lim et al. · 0 citations
Preprint Sep 2026

MultiVENT-Raw: A Benchmark for Retrieval and Reasoning over Raw Videos

MultiVENT-Raw is released, a multilingual collection of nearly 120,000 primarily raw videos paired with 130 events and 222 event-centric queries, along with human-annotated video relevance judgments and human-extracted key facts for relevant videos.

Reno Kriz, David Etter, Alexander Martin et al. · 0 citations
Preprint Oct 2026

VEDJE: Video-Efficient Discriminative Joint Encoder for Scalable Video-Text Retrieval

Finding the right video often requires distinguishing similar scenes in which different events occur. Joint matching improves retrieval, but processing rich video representations for each query is costly. VEDJE compresses features within sampled frames while keeping their representations separate in a reusable cache. F...

S. Wagner, Gabriele Serussi, D. Ben-Ami et al. · 0 citations
Preprint Aug 2026

ClearText-Video: A Large-Scale Text-Centric Video Dataset Bridging Video Restoration and Scene-Text Enhancement

ClearText-Video (CTVid), a large-scale, scene-text-aware benchmark for studying text-centric video understanding under controlled quality variation, is introduced, providing a rigorous foundation for restoration-aware, quality-robust text-centric video systems.

Jinlong Li, Jiaming Ding, Ding-Fu Lu et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Query-aligned video frame selection for long video understanding

Multimodal large language models (MLLMs) process multimodal inputs by converting text, images, and videos into token sequences that are subsequently processed by a backbone language model. While MLLMs have achieved excellent performance in understanding the content of individual images, video understanding remains sign...

Md. Safayet Islam, Dilip Sarkar, Liang-Yu Liang · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.