EchoMimic

EchoMimic is an open source digital human project launched by Alibaba, which successfully gives static images vivid voice and expression through advanced voice and image processing technologies.EchoMimic aims to break the limitations of traditional digital humans, so that the digital image is not only visually appealing, but also realizes natural and smooth voice interactions and expression changes, and brings users a more realistic and immersive experience. EchoMimic Features Audio Synchronized Animation: By analyzing audio waveforms, EchoMimic can accurately generate mouth and facial expressions synchronized with speech, providing...

Ant Group open-sourced a new project called EchoMimic on the 10th, which can help people "lip-sync" through facial features and audio, and combine facial landmarks and audio content to generate relatively stable and natural videos. The project has high stability and naturalness. By integrating the features of audio and facial landmarks (key facial features and structures, usually located in the eyes, nose, mouth, etc.), it can generate videos that are more in line with real facial movements and expression changes. It supports the use of audio or facial landmarks alone to generate portrait videos, and also supports combining audio and portrait photos to make "lip-syncing...