Audio-Visual-Textual Fusion for Emotion Recognition: A Neurologically Inspired Attention Mechanism
Systems that recognise emotion from speech, facial behaviour and language combine the three streams with mechanisms borrowed from machine translation rather than from any account of how the brain performs the same task. This article sets out a fusion mechanism derived from four established findings in multisensory neur...