Total runs:
2.2K
Run Growth:
1.9K
Growth Rate:
85.56%
Sponsored by
Agentkit
LoneStriker / 34b-beta-GGUF
Model's Last Updated: February 19 2024
Introduction of 34b-beta-GGUF
Model Details of 34b-beta-GGUF
CausalLM 34B β
PROMPT FORMAT:
There are some issues with the model weights in terms of precision. In the next version update, we will roll back some progress and retrain to fix these issues as soon as possible.
Please note: Do not use "accelerated inference frameworks" like VLLM temporarily. Instead, use Transformers for inference. Otherwise, due to precision issues, the output quality will be significantly degraded. If you need faster inference, you can consider using the q8_0 quantization (faster and better than bf16 vllm for this model only) with llama.cpp temporarily or wait for the official version. To be fixed in the upcoming next version update.
no repetition_penalty!
Please do not use wikitext for quantization calibration because all wikitext have been re-aligned on synthetic dataset, and its distribution differs significantly from the original wikitext.
MT-Bench: 8.5
Some contamination detection if you want to check:
| Models | MMLU (ref: llama7b) | TBA |
|---|---|---|
| microsoft/Orca-2-7b | 0.77 | |
| mistralai/Mistral-7B-v0.1 | 0.46 | |
| CausalLM/34b-beta | 0.38 | |
| 01-ai/Yi-6B-200K | 0.3 |
data from https://huggingface.co/spaces/Yeyito/llm_contamination_detector
It should be safe . It was not trained on the benchmark, but the contamination of the training dataset is unavoidable due to cost constraints.
Runs of LoneStriker 34b-beta-GGUF on huggingface.co
75
Total runs
-4
24-hour runs
-2
3-day runs
-5
7-day runs
-55
30-day runs
More Information About 34b-beta-GGUF huggingface.co Model
Url of 34b-beta-GGUF
34b-beta-GGUF huggingface.co Url
Provider of 34b-beta-GGUF huggingface.co
Other API from LoneStriker
Updated:January 28 2024
Total runs:
1.9K
Run Growth:
-4.5K
Growth Rate:
-233.71%
Total runs:
1.7K
Run Growth:
652
Growth Rate:
38.13%
Total runs:
1.6K
Run Growth:
1.4K
Growth Rate:
83.75%
Total runs:
1.1K
Run Growth:
42
Growth Rate:
3.67%
Total runs:
736
Run Growth:
-1.0K
Growth Rate:
-138.99%
Total runs:
508
Run Growth:
0
Growth Rate:
0.00%
Total runs:
497
Run Growth:
439
Growth Rate:
88.33%
Total runs:
478
Run Growth:
173
Growth Rate:
36.19%
Total runs:
470
Run Growth:
0
Growth Rate:
0.00%
Total runs:
462
Run Growth:
9
Growth Rate:
1.95%
Total runs:
446
Run Growth:
0
Growth Rate:
0.00%
Total runs:
445
Run Growth:
143
Growth Rate:
32.13%
Total runs:
404
Run Growth:
0
Growth Rate:
0.00%
Total runs:
349
Run Growth:
-109
Growth Rate:
-31.23%
Total runs:
348
Run Growth:
0
Growth Rate:
0.00%
Total runs:
347
Run Growth:
0
Growth Rate:
0.00%
Total runs:
303
Run Growth:
94
Growth Rate:
30.23%
Total runs:
293
Run Growth:
21
Growth Rate:
7.17%
Total runs:
288
Run Growth:
169
Growth Rate:
58.68%
Total runs:
288
Run Growth:
185
Growth Rate:
64.24%
Total runs:
271
Run Growth:
73
Growth Rate:
26.94%
Total runs:
260
Run Growth:
47
Growth Rate:
18.22%
Total runs:
255
Run Growth:
0
Growth Rate:
0.00%
Total runs:
257
Run Growth:
162
Growth Rate:
64.03%
Total runs:
250
Run Growth:
175
Growth Rate:
70.00%
Total runs:
242
Run Growth:
33
Growth Rate:
14.22%
Total runs:
241
Run Growth:
184
Growth Rate:
76.35%
Total runs:
234
Run Growth:
0
Growth Rate:
0.00%
Total runs:
230
Run Growth:
0
Growth Rate:
0.00%
Total runs:
203
Run Growth:
106
Growth Rate:
52.22%
Total runs:
202
Run Growth:
34
Growth Rate:
16.75%
Total runs:
179
Run Growth:
89
Growth Rate:
49.72%
Total runs:
178
Run Growth:
-217
Growth Rate:
-121.91%
Total runs:
189
Run Growth:
113
Growth Rate:
64.57%
Total runs:
173
Run Growth:
95
Growth Rate:
55.56%
Total runs:
170
Run Growth:
0
Growth Rate:
0.00%
Total runs:
169
Run Growth:
0
Growth Rate:
0.00%
Total runs:
168
Run Growth:
1
Growth Rate:
0.60%
Total runs:
162
Run Growth:
0
Growth Rate:
0.00%
Total runs:
139
Run Growth:
-38
Growth Rate:
-24.84%
Total runs:
152
Run Growth:
0
Growth Rate:
0.00%
Total runs:
151
Run Growth:
24
Growth Rate:
15.89%
Total runs:
150
Run Growth:
0
Growth Rate:
0.00%
Total runs:
151
Run Growth:
105
Growth Rate:
71.43%
Total runs:
145
Run Growth:
12
Growth Rate:
8.28%
Total runs:
145
Run Growth:
85
Growth Rate:
58.62%
Total runs:
140
Run Growth:
-952
Growth Rate:
-684.89%
Total runs:
146
Run Growth:
-8
Growth Rate:
-5.76%
Total runs:
137
Run Growth:
0
Growth Rate:
0.00%
Total runs:
131
Run Growth:
22
Growth Rate:
16.79%
Total runs:
129
Run Growth:
-98
Growth Rate:
-74.81%
Total runs:
131
Run Growth:
39
Growth Rate:
29.77%
Total runs:
130
Run Growth:
72
Growth Rate:
55.38%
Total runs:
128
Run Growth:
38
Growth Rate:
29.69%
Total runs:
125
Run Growth:
0
Growth Rate:
0.00%
Total runs:
129
Run Growth:
-15
Growth Rate:
-12.00%
Total runs:
124
Run Growth:
0
Growth Rate:
0.00%
Total runs:
123
Run Growth:
0
Growth Rate:
0.00%
Total runs:
122
Run Growth:
6
Growth Rate:
4.92%
Total runs:
120
Run Growth:
-164
Growth Rate:
-136.67%
Total runs:
112
Run Growth:
90
Growth Rate:
80.36%
Total runs:
111
Run Growth:
-24
Growth Rate:
-21.62%
Total runs:
111
Run Growth:
0
Growth Rate:
0.00%
Total runs:
103
Run Growth:
23
Growth Rate:
21.50%
Total runs:
107
Run Growth:
0
Growth Rate:
0.00%
Total runs:
99
Run Growth:
7
Growth Rate:
6.93%
Total runs:
101
Run Growth:
0
Growth Rate:
0.00%
Total runs:
99
Run Growth:
0
Growth Rate:
0.00%
Total runs:
99
Run Growth:
27
Growth Rate:
27.27%
Total runs:
97
Run Growth:
0
Growth Rate:
0.00%
Total runs:
96
Run Growth:
0
Growth Rate:
0.00%
Total runs:
95
Run Growth:
54
Growth Rate:
56.84%
Total runs:
95
Run Growth:
20
Growth Rate:
21.05%
Total runs:
93
Run Growth:
0
Growth Rate:
0.00%
Total runs:
92
Run Growth:
13
Growth Rate:
14.13%
Total runs:
91
Run Growth:
0
Growth Rate:
0.00%
Total runs:
91
Run Growth:
0
Growth Rate:
0.00%
Total runs:
74
Run Growth:
-190
Growth Rate:
-215.91%
Total runs:
87
Run Growth:
25
Growth Rate:
28.74%
Total runs:
87
Run Growth:
0
Growth Rate:
0.00%
Total runs:
85
Run Growth:
0
Growth Rate:
0.00%
Total runs:
84
Run Growth:
0
Growth Rate:
0.00%
Total runs:
84
Run Growth:
-1
Growth Rate:
-1.19%
Total runs:
84
Run Growth:
0
Growth Rate:
0.00%
Total runs:
80
Run Growth:
-3
Growth Rate:
-3.75%
Total runs:
79
Run Growth:
29
Growth Rate:
36.71%
Total runs:
79
Run Growth:
0
Growth Rate:
0.00%
Total runs:
77
Run Growth:
-10
Growth Rate:
-12.99%
Total runs:
76
Run Growth:
0
Growth Rate:
0.00%
Total runs:
76
Run Growth:
0
Growth Rate:
0.00%
Total runs:
74
Run Growth:
54
Growth Rate:
75.00%
Total runs:
70
Run Growth:
0
Growth Rate:
0.00%
Total runs:
67
Run Growth:
21
Growth Rate:
31.34%
Total runs:
64
Run Growth:
-44
Growth Rate:
-68.75%