LipAdapter: Text-to-Video Alignment is All You Need for Lip-to-Speech
Lip-to-Speech synthesis aims to generate intelligible, natural-sounding, and temporally synchronized speech from silent visual recordings of a speaker. Although recent end-to-end models have shown promising results, they require large amounts of training data and often lack out-of-dataset generalization. In this work,...