Sponsored by
ThumbnailCreator.com
ckpt / lcm-sdxl-unet
Model's Last Updated: November 10 2023
text-to-image
Introduction of lcm-sdxl-unet
Model Details of lcm-sdxl-unet
Latent Consistency Model (LCM): SDXL
Latent Consistency Model (LCM) was proposed in Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference by Simian Luo, Yiqin Tan et al. and Simian Luo , Suraj Patil , and Daniel Gu succesfully applied the same approach to create LCM for SDXL.
This checkpoint is a LCM distilled version of
stable-diffusion-xl-base-1.0
that allows
to reduce the number of inference steps to only between
2 - 8 steps
.
Usage
LCM SDXL is supported in 🤗 Hugging Face Diffusers library from version v0.23.0 onwards. To run the model, first
install the latest version of the Diffusers library as well as
peft
,
accelerate
and
transformers
.
audio dataset from the Hugging Face Hub:
pip install --upgrade pip
pip install --upgrade diffusers transformers accelerate peft
Text-to-Image
The model can be loaded with it's base pipeline
stabilityai/stable-diffusion-xl-base-1.0
. Next, the scheduler needs to be changed to
LCMScheduler
and we can reduce the number of inference steps to just 2 to 8 steps.
Please make sure to either disable
guidance_scale
or use values between 1.0 and 2.0.
from diffusers import UNet2DConditionModel, DiffusionPipeline, LCMScheduler
unet = UNet2DConditionModel.from_pretrained("latent-consistency/lcm-sdxl", torch_dtype=torch.float16, variant="fp16")
pipe = DiffusionPipeline.from_pretrained("stabilityai/stable-diffusion-xl-base-1.0", unet=unet, torch_dtype=torch.float16, variant="fp16")
pipe.scheduler = LCMScheduler.from_config(sd_pipe.scheduler.config)
pipe.to("cuda")
prompt = "a close-up picture of an old man standing in the rain"
image = pipe(prompt, num_inference_steps=4, guidance_scale=8.0).images[0]
Image-to-Image
Works as well! TODO docs
Inpainting
Works as well! TODO docs
ControlNet
Works as well! TODO docs
T2I Adapter
Works as well! TODO docs
Speed Benchmark
TODO
Training
TODO
Runs of ckpt lcm-sdxl-unet on huggingface.co
70
Total runs
2
24-hour runs
5
3-day runs
-1
7-day runs
50
30-day runs
More Information About lcm-sdxl-unet huggingface.co Model
Url of lcm-sdxl-unet
lcm-sdxl-unet huggingface.co Url
Provider of lcm-sdxl-unet huggingface.co
Other API from ckpt
Total runs:
4.8K
Run Growth:
32
Growth Rate:
0.66%
Total runs:
467
Run Growth:
218
Growth Rate:
46.68%
Total runs:
34
Run Growth:
7
Growth Rate:
20.59%
Total runs:
30
Run Growth:
-50
Growth Rate:
-166.67%
Total runs:
28
Run Growth:
8
Growth Rate:
28.57%
Total runs:
28
Run Growth:
-7
Growth Rate:
-25.00%
Total runs:
22
Run Growth:
-9
Growth Rate:
-40.91%
Total runs:
12
Run Growth:
4
Growth Rate:
33.33%
Total runs:
9
Run Growth:
3
Growth Rate:
33.33%
Total runs:
8
Run Growth:
2
Growth Rate:
25.00%
Total runs:
7
Run Growth:
-18
Growth Rate:
-257.14%
Total runs:
7
Run Growth:
-6
Growth Rate:
-85.71%
Total runs:
6
Run Growth:
1
Growth Rate:
16.67%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%