Total runs:
4.5K
Run Growth:
-921
Growth Rate:
-20.69%
Sponsored by
APIMart
ModelCloud / Llama-3.2-3B-Instruct-gptqmodel-4bit-vortex-v3
Model's Last Updated: November 11 2024
text-generation
Introduction of Llama-3.2-3B-Instruct-gptqmodel-4bit-vortex-v3
Model Details of Llama-3.2-3B-Instruct-gptqmodel-4bit-vortex-v3
This model has been quantized using GPTQModel .
- bits : 4
- dynamic : null
- group_size : 32
- desc_act : true
- static_groups : false
- sym : true
- lm_head : false
- true_sequential : true
- quant_method : "gptq"
- checkpoint_format : "gptq"
-
meta
：
- quantizer : gptqmodel:1.1.0
- uri : https://github.com/modelcloud/gptqmodel
- damp_percent : 0.1
- damp_auto_increment : 0.0015
Example:
from transformers import AutoTokenizer
from gptqmodel import GPTQModel
model_name = "ModelCloud/Llama-3.2-3B-Instruct-gptqmodel-4bit-vortex-v3"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = GPTQModel.from_quantized(model_name)
messages = [
{"role": "system", "content": "You are a pirate chatbot who always responds in pirate speak!"},
{"role": "user", "content": "Who are you?"},
]
input_tensor = tokenizer.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt")
outputs = model.generate(input_ids=input_tensor.to(model.device), max_new_tokens=512)
result = tokenizer.decode(outputs[0][input_tensor.shape[1]:], skip_special_tokens=True)
print(result)
Runs of ModelCloud Llama-3.2-3B-Instruct-gptqmodel-4bit-vortex-v3 on huggingface.co
34
Total runs
0
24-hour runs
0
3-day runs
-10
7-day runs
-763
30-day runs
More Information About Llama-3.2-3B-Instruct-gptqmodel-4bit-vortex-v3 huggingface.co Model
Url of Llama-3.2-3B-Instruct-gptqmodel-4bit-vortex-v3
Llama-3.2-3B-Instruct-gptqmodel-4bit-vortex-v3 huggingface.co Url
Provider of Llama-3.2-3B-Instruct-gptqmodel-4bit-vortex-v3 huggingface.co
Other API from ModelCloud
Updated:February 07 2025
Total runs:
4.5K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
956
Run Growth:
538
Growth Rate:
56.28%
Total runs:
924
Run Growth:
0
Growth Rate:
0.00%
Total runs:
801
Run Growth:
-1.3K
Growth Rate:
-165.54%
Total runs:
629
Run Growth:
263
Growth Rate:
41.81%
Total runs:
483
Run Growth:
0
Growth Rate:
0.00%
Total runs:
381
Run Growth:
-1.1K
Growth Rate:
-279.00%
Total runs:
378
Run Growth:
333
Growth Rate:
88.10%
Total runs:
339
Run Growth:
-899
Growth Rate:
-265.19%
Total runs:
306
Run Growth:
0
Growth Rate:
0.00%
Total runs:
269
Run Growth:
0
Growth Rate:
0.00%
Total runs:
266
Run Growth:
0
Growth Rate:
0.00%
Total runs:
255
Run Growth:
0
Growth Rate:
0.00%
Total runs:
222
Run Growth:
0
Growth Rate:
0.00%
Total runs:
171
Run Growth:
-1
Growth Rate:
-0.58%
Total runs:
148
Run Growth:
0
Growth Rate:
0.00%
Total runs:
146
Run Growth:
0
Growth Rate:
0.00%
Total runs:
127
Run Growth:
0
Growth Rate:
0.00%
Total runs:
116
Run Growth:
-19
Growth Rate:
-16.38%
Total runs:
113
Run Growth:
0
Growth Rate:
0.00%
Total runs:
82
Run Growth:
0
Growth Rate:
0.00%
Total runs:
81
Run Growth:
0
Growth Rate:
0.00%
Total runs:
77
Run Growth:
0
Growth Rate:
0.00%
Total runs:
69
Run Growth:
-199
Growth Rate:
-288.41%
Total runs:
49
Run Growth:
25
Growth Rate:
51.02%
Total runs:
46
Run Growth:
-31
Growth Rate:
-67.39%
Total runs:
44
Run Growth:
14
Growth Rate:
31.82%
Total runs:
42
Run Growth:
0
Growth Rate:
0.00%
Total runs:
41
Run Growth:
36
Growth Rate:
87.80%
Total runs:
38
Run Growth:
36
Growth Rate:
94.74%
Total runs:
38
Run Growth:
0
Growth Rate:
0.00%
Total runs:
35
Run Growth:
-21
Growth Rate:
-60.00%
Total runs:
34
Run Growth:
-10
Growth Rate:
-29.41%
Total runs:
32
Run Growth:
13
Growth Rate:
40.63%
Total runs:
27
Run Growth:
-13
Growth Rate:
-48.15%
Total runs:
25
Run Growth:
21
Growth Rate:
84.00%
Total runs:
25
Run Growth:
18
Growth Rate:
72.00%
Total runs:
25
Run Growth:
7
Growth Rate:
28.00%
Total runs:
24
Run Growth:
2
Growth Rate:
8.33%
Total runs:
21
Run Growth:
13
Growth Rate:
61.90%
Total runs:
17
Run Growth:
0
Growth Rate:
0.00%
Total runs:
16
Run Growth:
11
Growth Rate:
68.75%
Total runs:
16
Run Growth:
9
Growth Rate:
56.25%
Total runs:
14
Run Growth:
-8
Growth Rate:
-57.14%
Total runs:
13
Run Growth:
1
Growth Rate:
7.69%
Total runs:
11
Run Growth:
-1
Growth Rate:
-9.09%
Total runs:
11
Run Growth:
6
Growth Rate:
54.55%
Total runs:
10
Run Growth:
2
Growth Rate:
20.00%
Total runs:
9
Run Growth:
4
Growth Rate:
44.44%
Total runs:
9
Run Growth:
3
Growth Rate:
33.33%
Total runs:
9
Run Growth:
6
Growth Rate:
66.67%
Total runs:
9
Run Growth:
0
Growth Rate:
0.00%
Total runs:
9
Run Growth:
2
Growth Rate:
22.22%
Total runs:
9
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8
Run Growth:
6
Growth Rate:
60.00%
Total runs:
8
Run Growth:
-1
Growth Rate:
-12.50%
Total runs:
6
Run Growth:
0
Growth Rate:
0.00%
Total runs:
6
Run Growth:
0
Growth Rate:
0.00%
Total runs:
6
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
2
Growth Rate:
50.00%
Total runs:
4
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
-2
Growth Rate:
-50.00%
Total runs:
4
Run Growth:
-2
Growth Rate:
-50.00%
Total runs:
4
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
-26
Growth Rate:
-650.00%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%
Total runs:
3
Run Growth:
1
Growth Rate:
33.33%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
-1
Growth Rate:
-50.00%
Total runs:
1
Run Growth:
-5
Growth Rate:
-500.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%