Sponsored by
Vmake Labs Video Enhancer
-Vmake Labs Video Enhancer uses AI to improve video quality, restore details, reduce blur, and upscale videos to 8K.
Introduction of Kandinsky-6.0-VSR-distilled2steps-5s-Diffusers
Model Details of Kandinsky-6.0-VSR-distilled2steps-5s-Diffusers
Kandinsky 6.0: A family of diffusion models for Video + Audio generation
We present Kandinsky 6.0 Video, a family of foundation diffusion models for synchronized text-to-audio-video generation, comprising Kandinsky 6.0 Video Lite (3B parameters) and Kandinsky 6.0 Video Pro (29B parameters). Both models generate 5-second video clips with synchronized 44 kHz audio, including lip-sync, in text-to-audio-video (T2AV) and image-to-audio-video (TI2AV) modes; a plug-in super-resolution model raises the output resolution to Full-HD (1920×1080).
The complete
Kandinsky 6.0 video super-resolution
pipeline as a single 🧨 Diffusers bundle: the 1.4B SR DiT distilled with
π-Flow DX
down to
2 model evaluations per tile
, the KVAE video VAE and the x2 / x4 latent-upscaler bank. It upscales a video by x2, x2.25 or x4 with tiled diffusion in KVAE latent space. The Diffusers pipeline is video-only; mux the source audio back in if you need it in the output.
This repository contains all components needed for inference with
from_pretrained
. For the flow-matching teacher with 4 Euler steps per tile, see
the flow-matching Diffusers bundle
.
Usage with Diffusers
import torch
from diffusers import Kandinsky6SRPipeline
from diffusers.utils import export_to_video, load_video
torch._inductor.config.max_autotune = True# required: lets inductor pick flex-attention tiles that fit the SR block mask
pipe = Kandinsky6SRPipeline.from_pretrained("kandinskylab/Kandinsky-6.0-VSR-distilled2steps-5s-Diffusers", torch_dtype=torch.bfloat16)
pipe.enable_model_cpu_offload()
pipe.transformer.set_attention_backend("flex")
pipe.transformer.compile_repeated_blocks(fullgraph=True)
video = load_video("lq.mp4") # -> list[PIL.Image.Image]
output = pipe(
video=video,
resolution_scale=2.25, # 2, 2.25 or 4
num_inference_steps=2, # must be set explicitly -- the pipeline's own default (4) is for the flow-matching checkpoint
generator=torch.Generator("cuda").manual_seed(1137),
)
export_to_video(output.frames[0], "lq_sr.mp4", fps=24)
Video Super Resolution Models
Component
Repository
Diffusers bundle, π-Flow distilled (2 evaluations per tile) (this repository)
Kandinsky-6.0-VSR-distilled2steps-5s-Diffusers huggingface.co is an AI model on huggingface.co that provides Kandinsky-6.0-VSR-distilled2steps-5s-Diffusers's model effect (), which can be used instantly with this kandinskylab Kandinsky-6.0-VSR-distilled2steps-5s-Diffusers model. huggingface.co supports a free trial of the Kandinsky-6.0-VSR-distilled2steps-5s-Diffusers model, and also provides paid use of the Kandinsky-6.0-VSR-distilled2steps-5s-Diffusers. Support call Kandinsky-6.0-VSR-distilled2steps-5s-Diffusers model through api, including Node.js, Python, http.
Kandinsky-6.0-VSR-distilled2steps-5s-Diffusers huggingface.co is an online trial and call api platform, which integrates Kandinsky-6.0-VSR-distilled2steps-5s-Diffusers's modeling effects, including api services, and provides a free online trial of Kandinsky-6.0-VSR-distilled2steps-5s-Diffusers, you can try Kandinsky-6.0-VSR-distilled2steps-5s-Diffusers online for free by clicking the link below.
kandinskylab Kandinsky-6.0-VSR-distilled2steps-5s-Diffusers online free url in huggingface.co:
Kandinsky-6.0-VSR-distilled2steps-5s-Diffusers is an open source model from GitHub that offers a free installation service, and any user can find Kandinsky-6.0-VSR-distilled2steps-5s-Diffusers on GitHub to install. At the same time, huggingface.co provides the effect of Kandinsky-6.0-VSR-distilled2steps-5s-Diffusers install, users can directly use Kandinsky-6.0-VSR-distilled2steps-5s-Diffusers installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
Kandinsky-6.0-VSR-distilled2steps-5s-Diffusers install url in huggingface.co: