Aug 2026· IEEE Transactions on Image Processing· Vol 35, pp. 8678-8690· 0 citations· 93 references
Computer ScienceMedicine
Abstract
Event-guided video super-resolution (VSR) leverages high-temporal-resolution event streams to address motion blur, rapid dynamics, and poor illumination that challenge frame-only VSR methods. However, most existing approaches emphasize reconstruction quality while overlooking real-time performance and computational efficiency, limiting their deployment in latency-sensitive scenarios. To overcome these issues, we present E2VSR, a lightweight and Efficient Event-guided VSR framework tailored for real-time applications. Operating under a causal setting with only current and past observations, E2VSR is designed for low-latency event-guided VSR. We propose an event-confidence adaptive propagation strategy comprising two key modules: the Event-induced Feature Modulation (EvFM) block for robust cross-modal event-frame integration, and the Event-Confidence Feature Fusion (EvCFF) block, which exploits events as motion cues for adaptive inter-frame aggregation. This design improves motion-aware temporal aggregation in challenging dynamic conditions, where event cues may provide complementary temporal information. Furthermore, an Implicit Event Reconstruction (IER) technique leverages event information during training to enrich feature representations without adding inference-time cost, enhancing spatial and temporal fidelity. Experimental results demonstrate that E2VSR achieves superior quantitative and qualitative performance while maintaining a low parameter count and computational cost.
This work proposes an adapter-based framework that incorporates event-derived cues into a pre-trained image-to-video diffusion model with minimal architectural changes and consistently outperforms existing state-of-the-art approaches.
Gui-Xu Lin, Yu-Yang Yu, Xiang Ji et al.· 0 citations
Real-time 4K video super-resolution (VSR) requires the effective reuse of temporal information under strict latency constraints, typically relying on temporal alignment and real-time reconstruction. However, imperfect alignment introduces perturbations into the temporal recursion, which can accumulate over time and deg...
Ke-Mi Chen, Xian-Bin Zhang, Aiping Huang et al.· IEEE Transactions on Image P...· 0 citations
Experiments show that the proposed event-only framework outperforms Pre-SR and Post-SR baselines in both quantitative metrics and visual quality, demonstrating the effectiveness of reconstructing high-resolution radiance fields from low-resolution events alone.
Event cameras are increasingly used for Multiple Object Tracking (MOT), but their asynchronous event output often requires specialized methods. Existing processing methods primarily follow two paradigms, pseudo-frames and event-by-event. The former is the prevailing approach since its data format aligns with images, ma...
Mu-Xi Zha, Bang-Lei Guan, Min-Zu Liang et al.· IEEE Transactions on Image P...· 0 citations
ENCORE, an Event-Assisted Complementary Motion Refinement framework for learned video compression, employs Complementary Motion Representation to decompose aligned RGB-event features into common and modality-specific motion representations and identifies event-specific responses that are active and novel relative to RG...
Shuhan Ye, Hong Yu, Chenqi Kong et al.· arXiv.org· 0 citations
Two fundamentally different event compression pipelines are introduced, and five classification-based distortion metrics are applied to event compression for the first time, to the best of the authors'knowledge, and benchmarked against existing event stream metrics.
Zahra Rezaee, Catarina Brites, J. Ascenso· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.