Lip-to-Speech
Conducted Lip-to-Speech research across data processing, model training, and evaluation. The work involved VSR, ASR-guided generation, and diffusion models, with controlled experiments and error analysis to examine what works and where methods fail.
MultimodalSpeechDiffusionVSR