Total runs:
4.5K
Run Growth:
0
Growth Rate:
0.00%
Sponsored by
APIMart
ModelCloud / Falcon3-10B-Instruct-gptqmodel-4bit-vortex-v1
Model's Last Updated: December 21 2024
text-generation
Introduction of Falcon3-10B-Instruct-gptqmodel-4bit-vortex-v1
Model Details of Falcon3-10B-Instruct-gptqmodel-4bit-vortex-v1
This model has been quantized using GPTQModel .
- bits : 4
- dynamic : null
- group_size : 32
- desc_act : true
- static_groups : false
- sym : true
- lm_head : false
- true_sequential : true
- quant_method : "gptq"
- checkpoint_format : "gptq"
-
meta
：
- quantizer : gptqmodel:1.4.4
- uri : https://github.com/modelcloud/gptqmodel
- damp_percent : 0.1
- damp_auto_increment : 0.0025
Example:
from transformers import AutoTokenizer
from gptqmodel import GPTQModel
tokenizer = AutoTokenizer.from_pretrained("ModelCloud/Falcon3-10B-Instruct-gptqmodel-4bit-vortex-v1")
model = GPTQModel.load("ModelCloud/Falcon3-10B-Instruct-gptqmodel-4bit-vortex-v1")
messages = [
{"role": "user", "content": "How can I design a data structure in C++ to store the top 5 largest integer numbers?"},
]
input_tensor = tokenizer.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt")
outputs = model.generate(input_ids=input_tensor.to(model.device), max_new_tokens=512)
result = tokenizer.decode(outputs[0][input_tensor.shape[1]:], skip_special_tokens=True)
print(result)
Runs of ModelCloud Falcon3-10B-Instruct-gptqmodel-4bit-vortex-v1 on huggingface.co
4
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
-2
30-day runs
More Information About Falcon3-10B-Instruct-gptqmodel-4bit-vortex-v1 huggingface.co Model
Url of Falcon3-10B-Instruct-gptqmodel-4bit-vortex-v1
Falcon3-10B-Instruct-gptqmodel-4bit-vortex-v1 huggingface.co Url
Provider of Falcon3-10B-Instruct-gptqmodel-4bit-vortex-v1 huggingface.co
Other API from ModelCloud
Updated:July 29 2024
Total runs:
3.9K
Run Growth:
-1.6K
Growth Rate:
-40.45%
Total runs:
1.1K
Run Growth:
-600
Growth Rate:
-56.07%
Total runs:
956
Run Growth:
538
Growth Rate:
56.28%
Total runs:
924
Run Growth:
0
Growth Rate:
0.00%
Total runs:
629
Run Growth:
263
Growth Rate:
41.81%
Total runs:
483
Run Growth:
0
Growth Rate:
0.00%
Total runs:
381
Run Growth:
-1.1K
Growth Rate:
-279.00%
Total runs:
378
Run Growth:
333
Growth Rate:
88.10%
Total runs:
339
Run Growth:
-899
Growth Rate:
-265.19%
Total runs:
306
Run Growth:
0
Growth Rate:
0.00%
Total runs:
269
Run Growth:
0
Growth Rate:
0.00%
Total runs:
266
Run Growth:
0
Growth Rate:
0.00%
Total runs:
255
Run Growth:
0
Growth Rate:
0.00%
Total runs:
222
Run Growth:
0
Growth Rate:
0.00%
Total runs:
171
Run Growth:
-1
Growth Rate:
-0.58%
Total runs:
148
Run Growth:
0
Growth Rate:
0.00%
Total runs:
146
Run Growth:
0
Growth Rate:
0.00%
Total runs:
127
Run Growth:
0
Growth Rate:
0.00%
Total runs:
116
Run Growth:
-19
Growth Rate:
-16.38%
Total runs:
113
Run Growth:
0
Growth Rate:
0.00%
Total runs:
82
Run Growth:
0
Growth Rate:
0.00%
Total runs:
81
Run Growth:
0
Growth Rate:
0.00%
Total runs:
77
Run Growth:
0
Growth Rate:
0.00%
Total runs:
60
Run Growth:
-214
Growth Rate:
-345.16%
Total runs:
54
Run Growth:
26
Growth Rate:
49.06%
Total runs:
51
Run Growth:
47
Growth Rate:
92.16%
Total runs:
46
Run Growth:
-31
Growth Rate:
-67.39%
Total runs:
44
Run Growth:
12
Growth Rate:
27.27%
Total runs:
42
Run Growth:
0
Growth Rate:
0.00%
Total runs:
41
Run Growth:
36
Growth Rate:
87.80%
Total runs:
38
Run Growth:
0
Growth Rate:
0.00%
Total runs:
34
Run Growth:
-763
Growth Rate:
-2244.12%
Total runs:
32
Run Growth:
-28
Growth Rate:
-84.85%
Total runs:
32
Run Growth:
13
Growth Rate:
40.63%
Total runs:
27
Run Growth:
-23
Growth Rate:
-85.19%
Total runs:
25
Run Growth:
21
Growth Rate:
84.00%
Total runs:
25
Run Growth:
18
Growth Rate:
72.00%
Total runs:
25
Run Growth:
-17
Growth Rate:
-68.00%
Total runs:
24
Run Growth:
2
Growth Rate:
8.33%
Total runs:
19
Run Growth:
8
Growth Rate:
42.11%
Total runs:
18
Run Growth:
-7
Growth Rate:
-38.89%
Total runs:
17
Run Growth:
0
Growth Rate:
0.00%
Total runs:
17
Run Growth:
12
Growth Rate:
70.59%
Total runs:
15
Run Growth:
8
Growth Rate:
53.33%
Total runs:
14
Run Growth:
-8
Growth Rate:
-57.14%
Total runs:
13
Run Growth:
5
Growth Rate:
38.46%
Total runs:
12
Run Growth:
2
Growth Rate:
15.38%
Total runs:
12
Run Growth:
7
Growth Rate:
58.33%
Total runs:
11
Run Growth:
6
Growth Rate:
54.55%
Total runs:
11
Run Growth:
-1
Growth Rate:
-9.09%
Total runs:
9
Run Growth:
4
Growth Rate:
44.44%
Total runs:
9
Run Growth:
3
Growth Rate:
33.33%
Total runs:
9
Run Growth:
6
Growth Rate:
66.67%
Total runs:
9
Run Growth:
0
Growth Rate:
0.00%
Total runs:
9
Run Growth:
2
Growth Rate:
22.22%
Total runs:
9
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8
Run Growth:
-1
Growth Rate:
-12.50%
Total runs:
6
Run Growth:
0
Growth Rate:
0.00%
Total runs:
6
Run Growth:
0
Growth Rate:
0.00%
Total runs:
6
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
2
Growth Rate:
50.00%
Total runs:
4
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
-2
Growth Rate:
-50.00%
Total runs:
4
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
-26
Growth Rate:
-650.00%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%
Total runs:
3
Run Growth:
1
Growth Rate:
33.33%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
-1
Growth Rate:
-50.00%
Total runs:
1
Run Growth:
-5
Growth Rate:
-500.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%