Capybara
is a unified visual creation model, i.e., a powerful visual generation and editing framework designed for high-quality visual synthesis and manipulation tasks.
The framework leverages advanced diffusion models and transformer architectures to support versatile visual generation and editing capabilities with precise control over content, motion, and camera movements.
Speech-driven base clips generated by Seedance 2.0. All editing powered by CAPYBARA
Key Features:
🎬
Multi-Task Support
: Supports Text-to-Video (T2V), Text-to-Image (T2I), Instruction-based Video-to-Video (TV2V), Instruction-based Image-to-Image (TI2I), and various editing tasks
🚀
High Performance
: Built with distributed inference support for efficient multi-GPU processing
🔥 News
[2026.02.20]
🎨 Added
ComfyUI support
with custom nodes for all task types (T2I, T2V, TI2I, TV2V), together with
FP8 quantization
support for the inference script and ComfyUI custom node.
[2026.02.17]
🚀 Initial release v0.1 of the Capybara inference framework supporting generation and instruction-based editing tasks (T2I, T2V, TI2I, TV2V).
📝 TODO List
Add support for ComfyUI.
Release our unified creation model.
Release training code.
🏞️ Show Cases
Results of generation tasks.
We show two generation tasks under our unified model. The top section presents text-to-image results, illustrating high-fidelity synthesis across diverse styles. The bottom rows show text-to-video results, demonstrating temporally coherent generation with natural motion for both realistic and stylized content.
Results of image editing tasks.
We show the results of both instruction-based image editing and in-context image editing. The examples cover local and global edits (e.g., time-of-day and style changes), background replacement, and expression control. We further demonstrate multi-turn editing, where edits are applied sequentially. We also show in-context editing guided by a refenece image.
Results of instruction-based video editing task.
We showcase instruction-based editing (TV2V) under our unified creation interface, covering local edits, global edits, dense prediction, and dynamic edits. Each example presents input frames and the edited outputs, highlighting temporally coherent transformations that preserve identity and overall structure.
Results of in-context visual creation.
We show in-context generation and in-context editing results, including subject-conditioned generation (S2V/S2I), conditional generation (C2V), image-to-video (I2V), reference-driven editing (II2I/IV2V).
Recommended Settings
For optimal quality and performance, we recommend the following settings:
Task Type
Recommended Resolution
Recommended Steps
Note
Video
(T2V, TV2V)
480p
50
Balanced quality and generation speed
Image
(T2I, TI2I)
720p
50
Higher quality for static images
Notes:
Resolution
: You can experiment with higher resolutions (
1024
or
1080p
).
Inference Steps
: 50 steps provide a good balance between quality and speed. You can use 30-40 steps for faster generation.
If you find Capybara useful for your research, please consider citing:
@misc{capybara2026rao,
title={Capybara: A Unified Visual Creation Model},
author={Rao, Zhefan and Che, Haoxuan and Hu, Ziwen and Zou, Bin and Liu, Yaofang and He, Xuanhua and Choi, Chong-Hou and He, Yuyang and Chen, Haoyu and Su, Jingran and Li, Yanheng and Chu, Meng and Lei, Chenyang and Zhao, Guanhua and Li, Zhaoqing and Zhang, Xichen and Li, Anping and Liu, Lin and Tu, Dandan and Liu, Rui},
year={2026}
}
📧 Contact
For questions and feedback, please open an issue on GitHub.
Capybara-GGUF huggingface.co is an AI model on huggingface.co that provides Capybara-GGUF's model effect (), which can be used instantly with this vantagewithai Capybara-GGUF model. huggingface.co supports a free trial of the Capybara-GGUF model, and also provides paid use of the Capybara-GGUF. Support call Capybara-GGUF model through api, including Node.js, Python, http.
Capybara-GGUF huggingface.co is an online trial and call api platform, which integrates Capybara-GGUF's modeling effects, including api services, and provides a free online trial of Capybara-GGUF, you can try Capybara-GGUF online for free by clicking the link below.
vantagewithai Capybara-GGUF online free url in huggingface.co:
Capybara-GGUF is an open source model from GitHub that offers a free installation service, and any user can find Capybara-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of Capybara-GGUF install, users can directly use Capybara-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.