Total runs:
17.8K
Run Growth:
-14.6K
Growth Rate:
-82.36%
Sponsored by
Agentkit
TencentARC / MotionCtrl
Model's Last Updated: July 19 2024
Introduction of MotionCtrl
Model Details of MotionCtrl
MotionCtrl Model Card
Project Page | Paper (ArXiv) | Code
🤗 Gradio demo (MotionCtrl+VideoCrafter) | 🤗 Gradio demo (MotionCtrl+SVD)
Introduction
MotionCtrl, when provided with specific camera movements indicated by camera poses or several trajectories, can independently control both the camera and object motion in a generated video. It can be deployed on both Text-to-Video generation models, such as LVDM/VideoCrafter and AnimateDiff , as well as Image-to-Video generation models like SVD .
MotionCtrl + SVD
- Model: motionctrl.pth
- Results:
MotionCtrl + LVDM/VideoCrafter
- Model:
- Results:
MotionCtrl + AnimateDiff
- Model:
- Results:
Usage
- Download directly in this repository OR Download with python script
from huggingface_hub import hf_hub_download
motionctrl_lvdm_ckpt = hf_hub_download(repo_id="TencentARC/MotionCtrl", filename="motionctrl.ckpt", repo_type="model")
motionctrl_svd_ckpt = hf_hub_download(repo_id="TencentARC/MotionCtrl", filename="motionctrl_svd.ckpt", repo_type="model")
- Then generate the controllable video following the instructions in our GitHub repository .
Citation
@inproceedings{wang2023motionctrl,
title={MotionCtrl: A Unified and Flexible Motion Controller for Video Generation},
author={Wang, Zhouxia and Yuan, Ziyang and Wang, Xintao and Chen, Tianshui and Xia, Menghan and Luo, Ping and Shan, Yin},
booktitle={arXiv preprint arXiv:2312.03641},
year={2023}
}
Runs of TencentARC MotionCtrl on huggingface.co
0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About MotionCtrl huggingface.co Model
Url of MotionCtrl
MotionCtrl huggingface.co Url
Provider of MotionCtrl huggingface.co
Other API from TencentARC
Updated:April 11 2024
Create photos, paintings and avatars for anyone in any style within seconds.
Total runs:
5.3K
Run Growth:
-1.4K
Growth Rate:
-26.94%
Total runs:
2.8K
Run Growth:
525
Growth Rate:
19.06%
Total runs:
2.6K
Run Growth:
575
Growth Rate:
22.21%
Total runs:
2.2K
Run Growth:
786
Growth Rate:
35.26%
Total runs:
2.2K
Run Growth:
-59
Growth Rate:
-2.70%
Total runs:
1.9K
Run Growth:
256
Growth Rate:
13.60%
Total runs:
1.8K
Run Growth:
542
Growth Rate:
30.76%
Total runs:
1.8K
Run Growth:
230
Growth Rate:
13.13%
Total runs:
1.6K
Run Growth:
63
Growth Rate:
3.87%
Total runs:
1.1K
Run Growth:
-51
Growth Rate:
-4.67%
Total runs:
799
Run Growth:
-83
Growth Rate:
-10.39%
Total runs:
796
Run Growth:
-61
Growth Rate:
-7.66%
Total runs:
631
Run Growth:
-16
Growth Rate:
-2.54%
Total runs:
116
Run Growth:
-189
Growth Rate:
-162.93%
Total runs:
71
Run Growth:
33
Growth Rate:
46.48%
Total runs:
39
Run Growth:
20
Growth Rate:
51.28%
Total runs:
38
Run Growth:
-73
Growth Rate:
-192.11%
Total runs:
37
Run Growth:
-14
Growth Rate:
-37.84%
Total runs:
43
Run Growth:
-8
Growth Rate:
-22.22%
Total runs:
34
Run Growth:
17
Growth Rate:
53.13%
Total runs:
25
Run Growth:
-90
Growth Rate:
-360.00%
Total runs:
24
Run Growth:
9
Growth Rate:
37.50%
Total runs:
24
Run Growth:
14
Growth Rate:
58.33%
Total runs:
16
Run Growth:
-2
Growth Rate:
-12.50%
Total runs:
11
Run Growth:
3
Growth Rate:
27.27%
Total runs:
10
Run Growth:
-5
Growth Rate:
-50.00%
Total runs:
9
Run Growth:
2
Growth Rate:
22.22%
Total runs:
8
Run Growth:
-12
Growth Rate:
-150.00%
Total runs:
7
Run Growth:
-1
Growth Rate:
-14.29%
Total runs:
7
Run Growth:
-10
Growth Rate:
-142.86%
Total runs:
7
Run Growth:
1
Growth Rate:
14.29%
Total runs:
6
Run Growth:
-1
Growth Rate:
-11.11%
Total runs:
6
Run Growth:
0
Growth Rate:
0.00%
Total runs:
6
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
2
Growth Rate:
25.00%
Total runs:
4
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
-3
Growth Rate:
-75.00%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
-1
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%