UniVPM
Code for paper "Hearing Lips in Noise: Universal Viseme-Phoneme Mapping and Transfer for Robust Audio-Visual Speech Recognition"
Install / Use
/learn @YUCHEN005/UniVPMREADME
UniVPM (Universal Viseme-Phoneme Mapping)
This is the code implementation for paper Hearing Lips in Noise: Universal Viseme-Phoneme Mapping and Transfer for Robust Audio-Visual Speech Recognition that is built based on AV-HuBERT and Fairseq toolkit.
