Total runs:
4.5K
Run Growth:
0
Growth Rate:
0.00%
Sponsored by
Vmake Labs Video Enhancer
ModelCloud / QwQ-32B-gptqmodel-4bit-vortex-v1
Model's Last Updated: March 10 2025
text-generation
Introduction of QwQ-32B-gptqmodel-4bit-vortex-v1
Model Details of QwQ-32B-gptqmodel-4bit-vortex-v1
This model has been quantized using GPTQModel .
- bits : 4
- dynamic : null
- group_size : 32
- desc_act : true
- static_groups : false
- sym : true
- lm_head : false
- true_sequential : true
- quant_method : "gptq"
- checkpoint_format : "gptq"
-
meta
：
- quantizer : gptqmodel:2.0.0
- uri : https://github.com/modelcloud/gptqmodel
- damp_percent : 0.1
- damp_auto_increment : 0.0025
Example:
from transformers import AutoTokenizer
from gptqmodel import GPTQModel
tokenizer = AutoTokenizer.from_pretrained("ModelCloud/QwQ-32B-gptqmodel-4bit-vortex-v1")
model = GPTQModel.load("ModelCloud/QwQ-32B-gptqmodel-4bit-vortex-v1")
messages = [
{"role": "user", "content": "How many r's are in the word \"strawberry\""},
]
input_tensor = tokenizer.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt")
outputs = model.generate(input_ids=input_tensor.to(model.device), max_new_tokens=512)
result = tokenizer.decode(outputs[0][input_tensor.shape[1]:], skip_special_tokens=True)
print(result)
Runs of ModelCloud QwQ-32B-gptqmodel-4bit-vortex-v1 on huggingface.co
14
Total runs
0
24-hour runs
1
3-day runs
5
7-day runs
-8
30-day runs
More Information About QwQ-32B-gptqmodel-4bit-vortex-v1 huggingface.co Model
Url of QwQ-32B-gptqmodel-4bit-vortex-v1
QwQ-32B-gptqmodel-4bit-vortex-v1 huggingface.co Url
Provider of QwQ-32B-gptqmodel-4bit-vortex-v1 huggingface.co
Other API from ModelCloud
Updated:July 29 2024
Total runs:
3.6K
Run Growth:
-1.7K
Growth Rate:
-45.53%
Total runs:
1.1K
Run Growth:
-564
Growth Rate:
-52.86%
Total runs:
956
Run Growth:
538
Growth Rate:
56.28%
Total runs:
924
Run Growth:
0
Growth Rate:
0.00%
Total runs:
629
Run Growth:
263
Growth Rate:
41.81%
Total runs:
483
Run Growth:
0
Growth Rate:
0.00%
Total runs:
381
Run Growth:
-1.1K
Growth Rate:
-279.00%
Total runs:
378
Run Growth:
333
Growth Rate:
88.10%
Total runs:
339
Run Growth:
-899
Growth Rate:
-265.19%
Total runs:
306
Run Growth:
0
Growth Rate:
0.00%
Total runs:
269
Run Growth:
0
Growth Rate:
0.00%
Total runs:
266
Run Growth:
0
Growth Rate:
0.00%
Total runs:
255
Run Growth:
0
Growth Rate:
0.00%
Total runs:
222
Run Growth:
0
Growth Rate:
0.00%
Total runs:
171
Run Growth:
-1
Growth Rate:
-0.58%
Total runs:
148
Run Growth:
0
Growth Rate:
0.00%
Total runs:
146
Run Growth:
0
Growth Rate:
0.00%
Total runs:
127
Run Growth:
0
Growth Rate:
0.00%
Total runs:
116
Run Growth:
-19
Growth Rate:
-16.38%
Total runs:
113
Run Growth:
0
Growth Rate:
0.00%
Total runs:
82
Run Growth:
0
Growth Rate:
0.00%
Total runs:
81
Run Growth:
0
Growth Rate:
0.00%
Total runs:
77
Run Growth:
0
Growth Rate:
0.00%
Total runs:
57
Run Growth:
-219
Growth Rate:
-365.00%
Total runs:
55
Run Growth:
27
Growth Rate:
50.00%
Total runs:
50
Run Growth:
47
Growth Rate:
92.16%
Total runs:
46
Run Growth:
-31
Growth Rate:
-67.39%
Total runs:
46
Run Growth:
10
Growth Rate:
22.73%
Total runs:
42
Run Growth:
0
Growth Rate:
0.00%
Total runs:
41
Run Growth:
36
Growth Rate:
87.80%
Total runs:
38
Run Growth:
0
Growth Rate:
0.00%
Total runs:
34
Run Growth:
-763
Growth Rate:
-2244.12%
Total runs:
32
Run Growth:
13
Growth Rate:
40.63%
Total runs:
29
Run Growth:
-18
Growth Rate:
-56.25%
Total runs:
26
Run Growth:
-23
Growth Rate:
-88.46%
Total runs:
25
Run Growth:
21
Growth Rate:
84.00%
Total runs:
25
Run Growth:
18
Growth Rate:
72.00%
Total runs:
25
Run Growth:
-17
Growth Rate:
-68.00%
Total runs:
24
Run Growth:
2
Growth Rate:
8.33%
Total runs:
19
Run Growth:
-7
Growth Rate:
-38.89%
Total runs:
18
Run Growth:
12
Growth Rate:
70.59%
Total runs:
18
Run Growth:
7
Growth Rate:
38.89%
Total runs:
17
Run Growth:
0
Growth Rate:
0.00%
Total runs:
15
Run Growth:
8
Growth Rate:
53.33%
Total runs:
12
Run Growth:
0
Growth Rate:
0.00%
Total runs:
11
Run Growth:
6
Growth Rate:
54.55%
Total runs:
11
Run Growth:
-1
Growth Rate:
-9.09%
Total runs:
11
Run Growth:
4
Growth Rate:
33.33%
Total runs:
11
Run Growth:
8
Growth Rate:
66.67%
Total runs:
9
Run Growth:
4
Growth Rate:
44.44%
Total runs:
9
Run Growth:
3
Growth Rate:
33.33%
Total runs:
9
Run Growth:
6
Growth Rate:
66.67%
Total runs:
9
Run Growth:
0
Growth Rate:
0.00%
Total runs:
9
Run Growth:
2
Growth Rate:
22.22%
Total runs:
9
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8
Run Growth:
-1
Growth Rate:
-12.50%
Total runs:
6
Run Growth:
0
Growth Rate:
0.00%
Total runs:
6
Run Growth:
0
Growth Rate:
0.00%
Total runs:
6
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
2
Growth Rate:
50.00%
Total runs:
4
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
-2
Growth Rate:
-50.00%
Total runs:
4
Run Growth:
-2
Growth Rate:
-50.00%
Total runs:
4
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
-26
Growth Rate:
-650.00%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%
Total runs:
3
Run Growth:
1
Growth Rate:
33.33%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
-1
Growth Rate:
-50.00%
Total runs:
1
Run Growth:
-5
Growth Rate:
-500.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%