Total runs:
121.5K
Run Growth:
7.1K
Growth Rate:
5.82%
Sponsored by
APIMart
second-state / Qwen2.5-72B-Instruct-GGUF
Model's Last Updated: September 20 2024
text-generation
Introduction of Qwen2.5-72B-Instruct-GGUF
Model Details of Qwen2.5-72B-Instruct-GGUF
Qwen2.5-72B-Instruct-GGUF
Original Model
Run with LlamaEdge
-
LlamaEdge version: v0.14.3
-
Prompt template
-
Prompt type:
chatml -
Prompt string
<|im_start|>system {system_message}<|im_end|> <|im_start|>user {prompt}<|im_end|> <|im_start|>assistant
-
-
Context size:
131072 -
Run as LlamaEdge service
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Qwen2.5-72B-Instruct-Q5_K_M.gguf \ llama-api-server.wasm \ --model-name Qwen2.5-72B-Instruct \ --prompt-template chatml \ --ctx-size 131072 -
Run as LlamaEdge command app
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Qwen2.5-72B-Instruct-Q5_K_M.gguf \ llama-chat.wasm \ --prompt-template chatml \ --ctx-size 131072
Quantized with llama.cpp b3751
Runs of second-state Qwen2.5-72B-Instruct-GGUF on huggingface.co
41.3K
Total runs
0
24-hour runs
0
3-day runs
184
7-day runs
543
30-day runs
More Information About Qwen2.5-72B-Instruct-GGUF huggingface.co Model
Url of Qwen2.5-72B-Instruct-GGUF
Qwen2.5-72B-Instruct-GGUF huggingface.co Url
Provider of Qwen2.5-72B-Instruct-GGUF huggingface.co
Other API from second-state
Updated:May 01 2024
Total runs:
35.7K
Run Growth:
8.5K
Growth Rate:
23.96%
Total runs:
18.7K
Run Growth:
-769
Growth Rate:
-4.12%
Total runs:
15.4K
Run Growth:
-1.1K
Growth Rate:
-7.16%
Total runs:
12.5K
Run Growth:
72
Growth Rate:
0.57%
Total runs:
4.8K
Run Growth:
-325
Growth Rate:
-7.98%
Total runs:
3.8K
Run Growth:
1.0K
Growth Rate:
27.52%
Total runs:
3.7K
Run Growth:
597
Growth Rate:
16.35%
Total runs:
3.6K
Run Growth:
2.1K
Growth Rate:
59.23%
Total runs:
3.5K
Run Growth:
642
Growth Rate:
17.87%
Total runs:
3.3K
Run Growth:
282
Growth Rate:
8.43%
Total runs:
3.3K
Run Growth:
1.1K
Growth Rate:
31.86%
Total runs:
3.0K
Run Growth:
-6
Growth Rate:
-0.20%
Total runs:
2.8K
Run Growth:
721
Growth Rate:
25.77%
Total runs:
2.8K
Run Growth:
352
Growth Rate:
13.28%
Total runs:
2.7K
Run Growth:
431
Growth Rate:
16.02%
Total runs:
2.5K
Run Growth:
734
Growth Rate:
28.73%
Total runs:
2.3K
Run Growth:
-321
Growth Rate:
-13.72%
Total runs:
2.1K
Run Growth:
794
Growth Rate:
37.92%
Total runs:
2.1K
Run Growth:
454
Growth Rate:
21.38%
Total runs:
2.1K
Run Growth:
227
Growth Rate:
10.95%
Total runs:
2.1K
Run Growth:
619
Growth Rate:
29.92%
Total runs:
2.1K
Run Growth:
239
Growth Rate:
11.94%
Total runs:
1.8K
Run Growth:
-39
Growth Rate:
-2.13%
Total runs:
1.7K
Run Growth:
-648
Growth Rate:
-35.43%
Total runs:
1.6K
Run Growth:
314
Growth Rate:
19.25%
Total runs:
1.6K
Run Growth:
371
Growth Rate:
23.35%
Total runs:
1.5K
Run Growth:
629
Growth Rate:
40.92%
Total runs:
1.5K
Run Growth:
569
Growth Rate:
39.49%
Total runs:
1.4K
Run Growth:
406
Growth Rate:
29.57%
Total runs:
1.4K
Run Growth:
655
Growth Rate:
46.29%
Total runs:
1.3K
Run Growth:
261
Growth Rate:
19.22%
Total runs:
1.3K
Run Growth:
-903
Growth Rate:
-67.95%
Total runs:
1.3K
Run Growth:
-750
Growth Rate:
-57.60%
Total runs:
1.3K
Run Growth:
330
Growth Rate:
25.44%
Total runs:
1.3K
Run Growth:
558
Growth Rate:
41.55%
Total runs:
1.3K
Run Growth:
-612
Growth Rate:
-47.96%
Total runs:
1.2K
Run Growth:
-137
Growth Rate:
-11.18%
Total runs:
1.2K
Run Growth:
-304
Growth Rate:
-24.82%
Total runs:
1.2K
Run Growth:
383
Growth Rate:
31.76%
Total runs:
1.1K
Run Growth:
190
Growth Rate:
18.50%
Total runs:
1.1K
Run Growth:
218
Growth Rate:
19.93%
Total runs:
1.1K
Run Growth:
444
Growth Rate:
39.29%
Total runs:
1.1K
Run Growth:
-562
Growth Rate:
-52.52%
Total runs:
1.1K
Run Growth:
-347
Growth Rate:
-32.37%
Total runs:
1.0K
Run Growth:
289
Growth Rate:
25.87%
Total runs:
1.0K
Run Growth:
398
Growth Rate:
38.68%
Total runs:
993
Run Growth:
330
Growth Rate:
33.23%
Total runs:
979
Run Growth:
447
Growth Rate:
45.47%
Total runs:
963
Run Growth:
358
Growth Rate:
38.83%
Total runs:
950
Run Growth:
317
Growth Rate:
32.99%
Total runs:
944
Run Growth:
731
Growth Rate:
84.22%
Total runs:
931
Run Growth:
8
Growth Rate:
0.87%
Total runs:
902
Run Growth:
241
Growth Rate:
26.45%
Total runs:
875
Run Growth:
218
Growth Rate:
26.01%
Total runs:
873
Run Growth:
530
Growth Rate:
60.57%
Total runs:
872
Run Growth:
691
Growth Rate:
75.60%
Total runs:
863
Run Growth:
383
Growth Rate:
44.53%
Total runs:
863
Run Growth:
592
Growth Rate:
68.60%
Total runs:
846
Run Growth:
305
Growth Rate:
35.59%
Total runs:
819
Run Growth:
577
Growth Rate:
73.88%
Total runs:
815
Run Growth:
454
Growth Rate:
58.88%
Total runs:
811
Run Growth:
21
Growth Rate:
2.55%
Total runs:
782
Run Growth:
355
Growth Rate:
45.51%
Total runs:
763
Run Growth:
324
Growth Rate:
45.44%
Total runs:
753
Run Growth:
426
Growth Rate:
56.35%
Total runs:
748
Run Growth:
407
Growth Rate:
54.48%
Total runs:
746
Run Growth:
147
Growth Rate:
21.68%
Total runs:
723
Run Growth:
405
Growth Rate:
56.02%
Total runs:
723
Run Growth:
523
Growth Rate:
72.34%
Total runs:
695
Run Growth:
248
Growth Rate:
34.98%
Total runs:
694
Run Growth:
520
Growth Rate:
74.93%
Total runs:
691
Run Growth:
332
Growth Rate:
47.70%
Total runs:
690
Run Growth:
266
Growth Rate:
38.55%
Total runs:
675
Run Growth:
-86
Growth Rate:
-12.57%
Total runs:
651
Run Growth:
294
Growth Rate:
50.34%
Total runs:
634
Run Growth:
353
Growth Rate:
61.82%
Total runs:
616
Run Growth:
258
Growth Rate:
44.95%
Total runs:
615
Run Growth:
209
Growth Rate:
33.17%
Total runs:
599
Run Growth:
320
Growth Rate:
53.42%
Total runs:
589
Run Growth:
303
Growth Rate:
51.44%
Total runs:
575
Run Growth:
164
Growth Rate:
28.52%
Total runs:
573
Run Growth:
-107
Growth Rate:
-18.67%
Total runs:
560
Run Growth:
214
Growth Rate:
37.68%
Total runs:
527
Run Growth:
0
Growth Rate:
0.00%
Total runs:
524
Run Growth:
78
Growth Rate:
14.89%
Total runs:
515
Run Growth:
196
Growth Rate:
38.06%
Total runs:
502
Run Growth:
245
Growth Rate:
48.80%
Total runs:
494
Run Growth:
158
Growth Rate:
31.98%
Total runs:
490
Run Growth:
353
Growth Rate:
72.04%
Total runs:
487
Run Growth:
-742
Growth Rate:
-152.36%
Total runs:
483
Run Growth:
13
Growth Rate:
2.69%
Total runs:
481
Run Growth:
-100
Growth Rate:
-20.79%
Total runs:
479
Run Growth:
178
Growth Rate:
41.01%
Total runs:
475
Run Growth:
155
Growth Rate:
34.22%
Total runs:
463
Run Growth:
96
Growth Rate:
20.73%
Total runs:
447
Run Growth:
130
Growth Rate:
29.02%
Total runs:
429
Run Growth:
182
Growth Rate:
42.42%
Total runs:
427
Run Growth:
-84
Growth Rate:
-19.67%
Total runs:
423
Run Growth:
93
Growth Rate:
21.99%