UniCache: Task- and Type-Aware KV Cache Compression for Unified Multimodal Models
Unified multimodal models combine understanding, generation, and editing within a single network, offering a promising foundation for versatile multimodal applications. However, growing multimodal contexts make KV cache storage and access increasingly costly. Existing KV cache compression methods are typically tailored...
Wan-Qi Yang, Yue-Xiao Ma, Mei Xie et al.
· 0 citations