Total runs:
136.2K
Run Growth:
19.6K
Growth Rate:
14.37%
Sponsored by
AdsCreator.com
diffusers / FLUX.1-dev-torchao-int4
Model's Last Updated: May 21 2025
text-to-image
Introduction of FLUX.1-dev-torchao-int4
Model Details of FLUX.1-dev-torchao-int4
Visual comparison of Flux-dev model outputs using BF16 and torchao int4_weight_only quantization
BF16
torchao int4_weight_only
Usage with Diffusers
To use this quantized FLUX.1 [dev] checkpoint, you need to install the 🧨 diffusers and torchao library:
pip install -U torchao
For now, we require this specific branch in diffusers library to fix an error when loading the model
pip install git+https://github.com/huggingface/diffusers.git@torchao-int4-serialization
After installing the required library, you can run the following script:
from diffusers import FluxPipeline
pipe = FluxPipeline.from_pretrained(
"diffusers/FLUX.1-dev-torchao-int4",
torch_dtype=torch.bfloat16,
use_safetensors=False,
device_map="balanced"
)
prompt = "Baroque style, a lavish palace interior with ornate gilded ceilings, intricate tapestries, and dramatic lighting over a grand staircase."
pipe_kwargs = {
"prompt": prompt,
"height": 1024,
"width": 1024,
"guidance_scale": 3.5,
"num_inference_steps": 50,
"max_sequence_length": 512,
}
image = pipe(
**pipe_kwargs, generator=torch.manual_seed(0),
).images[0]
image.save("flux.png")
How to generate this quantized checkpoint ?
This checkpoint was created with the following script using "black-forest-labs/FLUX.1-dev" checkpoint:
import torch
from diffusers import FluxPipeline
from diffusers.quantizers import PipelineQuantizationConfig
from diffusers import TorchAoConfig as DiffusersTorchAoConfig
from transformers import TorchAoConfig as TransformersTorchAoConfig
pipeline_quant_config = PipelineQuantizationConfig(
quant_mapping={
"transformer": DiffusersTorchAoConfig("int4_weight_only"),
"text_encoder_2": TransformersTorchAoConfig("int4_weight_only"),
}
)
pipe = FluxPipeline.from_pretrained(
"black-forest-labs/FLUX.1-dev",
quantization_config=pipeline_quant_config,
torch_dtype=torch.bfloat16,
device_map="balanced"
)
# safe_serialization set to `False` as we can't save torchao quantized model to safetensors format
pipe.save_pretrained("FLUX.1-dev-torchao-int4", safe_serialization=False)
Runs of diffusers FLUX.1-dev-torchao-int4 on huggingface.co
7
Total runs
0
24-hour runs
0
3-day runs
-5
7-day runs
-9
30-day runs
More Information About FLUX.1-dev-torchao-int4 huggingface.co Model
Url of FLUX.1-dev-torchao-int4
FLUX.1-dev-torchao-int4 huggingface.co Url
Provider of FLUX.1-dev-torchao-int4 huggingface.co
Other API from diffusers
Updated:September 04 2023
Total runs:
27.0K
Run Growth:
1.7K
Growth Rate:
6.25%
Total runs:
24.5K
Run Growth:
6.3K
Growth Rate:
25.75%
Total runs:
19.0K
Run Growth:
-4.1K
Growth Rate:
-21.49%
Total runs:
7.6K
Run Growth:
-859
Growth Rate:
-11.36%
Total runs:
7.2K
Run Growth:
6.2K
Growth Rate:
86.32%
Total runs:
3.5K
Run Growth:
507
Growth Rate:
14.32%
Total runs:
2.9K
Run Growth:
-92
Growth Rate:
-3.16%
Total runs:
1.9K
Run Growth:
323
Growth Rate:
16.81%
Total runs:
1.3K
Run Growth:
526
Growth Rate:
39.55%
Total runs:
1.3K
Run Growth:
750
Growth Rate:
58.32%
Total runs:
828
Run Growth:
366
Growth Rate:
44.20%
Total runs:
818
Run Growth:
-1.3K
Growth Rate:
-157.09%
Total runs:
592
Run Growth:
-66
Growth Rate:
-11.15%
Total runs:
372
Run Growth:
-294
Growth Rate:
-79.03%
Total runs:
223
Run Growth:
135
Growth Rate:
60.54%
Total runs:
152
Run Growth:
50
Growth Rate:
32.89%
Total runs:
117
Run Growth:
-20
Growth Rate:
-17.09%
Total runs:
112
Run Growth:
-75
Growth Rate:
-66.96%
Total runs:
95
Run Growth:
30
Growth Rate:
31.58%
Total runs:
86
Run Growth:
-28
Growth Rate:
-32.56%
Total runs:
30
Run Growth:
10
Growth Rate:
33.33%
Total runs:
30
Run Growth:
2
Growth Rate:
6.67%
Total runs:
20
Run Growth:
14
Growth Rate:
70.00%
Total runs:
18
Run Growth:
18
Growth Rate:
100.00%
Total runs:
15
Run Growth:
11
Growth Rate:
73.33%
Total runs:
13
Run Growth:
5
Growth Rate:
41.67%
Total runs:
13
Run Growth:
11
Growth Rate:
84.62%
Total runs:
13
Run Growth:
12
Growth Rate:
92.31%
Total runs:
12
Run Growth:
12
Growth Rate:
100.00%
Total runs:
11
Run Growth:
10
Growth Rate:
90.91%
Total runs:
10
Run Growth:
9
Growth Rate:
90.00%
Total runs:
9
Run Growth:
-53
Growth Rate:
-588.89%
Total runs:
9
Run Growth:
2
Growth Rate:
22.22%
Total runs:
7
Run Growth:
5
Growth Rate:
71.43%
Total runs:
7
Run Growth:
3
Growth Rate:
42.86%
Total runs:
6
Run Growth:
-3
Growth Rate:
-50.00%
Total runs:
6
Run Growth:
-15
Growth Rate:
-250.00%
Total runs:
5
Run Growth:
1
Growth Rate:
20.00%
Total runs:
5
Run Growth:
2
Growth Rate:
40.00%
Total runs:
5
Run Growth:
5
Growth Rate:
100.00%
Total runs:
4
Run Growth:
2
Growth Rate:
50.00%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
2
Growth Rate:
100.00%
Total runs:
2
Run Growth:
-13
Growth Rate:
-650.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%