Hai-Chen He

Revisiting Natural Language Prompts from Large Language Models for Open-Vocabulary Video Recognition

Vision-language models (VLMs) like CLIP have shown great success in image tasks, however, applying CLIP to open-vocabulary video recognition poses challenges. Due to the limited text information, directly fine-tuning CLIP on video recognition datasets may lead to overfitting and hinder its generalizability. A prevalent...