InfiniteTalk: Audio-driven Video Generation for Sparse-Frame Video Dubbing
We propose
InfiniteTalk
, a novel sparse-frame video dubbing framework. Given an input video and audio track, InfiniteTalk synthesizes a new video with accurate lip synchronization while simultaneously aligning head movements, body posture, and facial expressions with the audio. Unlike traditional dubbing methods that focus solely on lips, InfiniteTalk enables infinite-length video generation with accurate lip synchronization and consistent identity preservation. Beside, InfiniteTalk can also be used as an image-audio-to-video model with an image and an audio as input.
💬 Sparse-frame Video Dubbing – Synchronizes not only lips, but aslo head, body, and expressions
⏱️ Infinite-Length Generation – Supports unlimited video duration
✨ Stability – Reduces hand/body distortions compared to MultiTalk
🚀 Lip Accuracy – Achieves superior lip synchronization to MultiTalk
This repository hosts the model weights for
InfiniteTalk
. For installation, usage instructions, and further documentation, please visit our
GitHub repository
.
License Agreement
The models in this repository are licensed under the Apache 2.0 License. We claim no rights over the your generated contents, granting you the freedom to use them while ensuring that your usage complies with the provisions of this license. You are fully accountable for your use of the models, which must not involve sharing any content that violates applicable laws, causes harm to individuals or groups, disseminates personal information intended for harm, spreads misinformation, or targets vulnerable populations.
Runs of eadx InfiniteTalk on huggingface.co
52
Total runs
14
24-hour runs
8
3-day runs
8
7-day runs
-49
30-day runs
More Information About InfiniteTalk huggingface.co Model
InfiniteTalk huggingface.co is an AI model on huggingface.co that provides InfiniteTalk's model effect (), which can be used instantly with this eadx InfiniteTalk model. huggingface.co supports a free trial of the InfiniteTalk model, and also provides paid use of the InfiniteTalk. Support call InfiniteTalk model through api, including Node.js, Python, http.
InfiniteTalk huggingface.co is an online trial and call api platform, which integrates InfiniteTalk's modeling effects, including api services, and provides a free online trial of InfiniteTalk, you can try InfiniteTalk online for free by clicking the link below.
eadx InfiniteTalk online free url in huggingface.co:
InfiniteTalk is an open source model from GitHub that offers a free installation service, and any user can find InfiniteTalk on GitHub to install. At the same time, huggingface.co provides the effect of InfiniteTalk install, users can directly use InfiniteTalk installed effect in huggingface.co for debugging and trial. It also supports api for free installation.