Waseem Ullah

Cross-modal Fusion Transformer for Integrating Retrieved Knowledge into Video Caption Generation

A video-aware knowledge fusion approach that integrates retrieved knowledge at the feature level prior to generation that improves CIDEr on challenging datasets such as YouCook2 and Ego4D-HCap, indicating that feature-level knowledge fusion can enhance semantic coverage in long-form caption generation.