Readme
original repo: https://github.com/OpenTalker/SadTalker
TL;DR: single portrait image 🙎♂️ + audio 🎤 = talking head video 🎞.
</div>🛎 Citation
If you find our work useful in your research, please consider citing:
@article{zhang2022sadtalker,
title={SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation},
author={Zhang, Wenxuan and Cun, Xiaodong and Wang, Xuan and Zhang, Yong and Shen, Xi and Guo, Yu and Shan, Ying and Wang, Fei},
journal={arXiv preprint arXiv:2211.12194},
year={2022}
}
💗 Acknowledgements
Facerender code borrows heavily from zhanglonghao’s reproduction of face-vid2vid and PIRender . We thank the authors for sharing their wonderful code. In training process, We also use the model from Deep3DFaceReconstruction and Wav2lip . We thank for their wonderful work.
See also these wonderful 3rd libraries we use:
- Face Utils : https://github.com/xinntao/facexlib
- Face Enhancement : https://github.com/TencentARC/GFPGAN
- Image/Video Enhancement : https://github.com/xinntao/Real-ESRGAN
🥂 Extensions:
- SadTalker-Video-Lip-Sync from @Zz-ww : SadTalker for Video Lip Editing
🥂 Related Works
- StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGAN (ECCV 2022)
- CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion Prior (CVPR 2023)
- VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wild (SIGGRAPH Asia 2022)
- DPE: Disentanglement of Pose and Expression for General Video Portrait Editing (CVPR 2023)
- 3D GAN Inversion with Facial Symmetry Prior (CVPR 2023)
- T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representations (CVPR 2023)
📢 Disclaimer
This is not an official product of Tencent. This repository can only be used for personal/research/non-commercial purposes.
LOGO: color and font suggestion: ChatGPT , logo font: Montserrat Alternates .
All the copyright of the demo images and audio are from communities users or the geneartion from stable diffusion. Free free to contact us if you feel uncomfortable.


