Sponsored by
APIMart
p1atdev / CogView4-6B-quanto_int8
Model's Last Updated: March 09 2025
Introduction of CogView4-6B-quanto_int8
Model Details of CogView4-6B-quanto_int8
Quantization settings
-
vae.:torch.bfloat16. No quantization. -
text_encoder.layers.:- Int8 with Optimum Quanto
-
Target layers:
["q_proj", "k_proj", "v_proj", "o_proj", "mlp.down_proj", "mlp.gate_up_proj"]
-
diffusion_model.:- Int8 with Optimum Quanto
-
Target layers:
["to_q", "to_k", "to_v", "to_out.0", "ff.net.0.proj", "ff.net.2"]
VRAM cosumption
-
Text encoder (
text_encoder.): about 11 GB -
Denoiser (
diffusion_model.): about 10 GB
Samples
torch.bfloat16
|
Quanto Int8 |
|---|---|
|
|
| VRAM 40GB (without offloading) | VRAM 28GB (without offloading) |
Generation parameters
-
prompt:
""" A photo of a nendoroid figure of hatsune miku holding a sign that says "CogView4" """" -
negative_prompt:
"blurry, low quality, horror" -
height:
1152 -
width:
1152 -
cfg_scale:
3.5 -
num_inference_steps:
20
Runs of p1atdev CogView4-6B-quanto_int8 on huggingface.co
0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About CogView4-6B-quanto_int8 huggingface.co Model
Url of CogView4-6B-quanto_int8
CogView4-6B-quanto_int8 huggingface.co Url
Provider of CogView4-6B-quanto_int8 huggingface.co
Other API from p1atdev
Total runs:
2.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.5K
Run Growth:
-1.7K
Growth Rate:
-113.05%
Total runs:
303
Run Growth:
154
Growth Rate:
50.66%
Total runs:
133
Run Growth:
-63
Growth Rate:
-47.37%
Total runs:
104
Run Growth:
0
Growth Rate:
0.00%
Total runs:
103
Run Growth:
4
Growth Rate:
3.88%
Total runs:
54
Run Growth:
45
Growth Rate:
83.33%
Total runs:
43
Run Growth:
31
Growth Rate:
72.09%
Total runs:
27
Run Growth:
-6
Growth Rate:
-22.22%
Total runs:
22
Run Growth:
9
Growth Rate:
40.91%
Total runs:
21
Run Growth:
8
Growth Rate:
38.10%
Total runs:
18
Run Growth:
-17
Growth Rate:
-94.44%
Total runs:
13
Run Growth:
10
Growth Rate:
76.92%
Total runs:
10
Run Growth:
1
Growth Rate:
10.00%
Total runs:
10
Run Growth:
4
Growth Rate:
40.00%
Total runs:
8
Run Growth:
-1
Growth Rate:
-12.50%
Total runs:
5
Run Growth:
2
Growth Rate:
40.00%
Total runs:
3
Run Growth:
-7
Growth Rate:
-233.33%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
-1
Growth Rate:
-50.00%
Total runs:
2
Run Growth:
-3
Growth Rate:
-150.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
-4
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
-3
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%