Buzhou Tang

Prototype-as-Prompt: Multimodal Sentiment Prototypes Endowing Large Language Models the Capability to Perform Multimodal Sentiment Analysis

A prototype-as-prompt framework that maps audio–visual representations into a fixed set of multimodal sentiment prototypes that are used as soft prompts to guide the LLM in performing MSA and introduces a sentiment-aware prototype learning that explicitly binds multimodal prototypes with sentiment semantics.