CLS-Guided Multimodal Fusion for Image Captioning with LSTM and T5 Decoders
Turning visual evidence into coherent sentences depends on how visual and linguistic representations are combined before decoding. We present two decoder-specific generation strategies, CLS-LSTM and CLS-T5, built on a common CLS-guided Swin–BERT multimodal backbone. Swin-Base extracts a 7×7 grid of 49 spatial feature v...