Total runs:
3.0K
Run Growth:
449
Growth Rate:
14.78%
Sponsored by
APIMart
KnutJaegersberg / Tess-M-34B-2bit
Model's Last Updated: January 03 2024
text-generation
Introduction of Tess-M-34B-2bit
Model Details of Tess-M-34B-2bit
This is a 2-bit quantization of @migtissera Tess-M-34b-v1.4 using quip# ( https://cornell-relaxml.github.io/quip-sharp/ ) with hessian context lenght 8k.
"Tess, short for Tesoro (Treasure in Italian), is a general purpose Large Language Model series. Tess-M-v1.4 was trained on the Yi-34B-200K base."
Perplexity on the dev set as repoted by quip# was slightly below 7 compared to slightly below 6 of the original. Inference with the model is a bit slow, but with the long context length it should provide one of the best performing few-shot models for consumer and data science GPUs, especially if the instances are longer and the answers relatively short.
Prompt Format:
SYSTEM: <ANY SYSTEM CONTEXT>
USER:
ASSISTANT:
I am able to use this model in the widely known textgen-webui. For installation I suggest to follow these steps:
- Put the current quip# library folder into the repositories folder of the textgen-webui folder.
- install the requirements of quip#
- compile and install the quiptools cuda lib:
pip install fast-hadamard-transform glog==0.3.1 primefac==2.0.12
cd repositories/quip-sharp/quiptools
python setup.py install --force
- reinstall the requirements of textgen-webui
- load the model with the quip# integration of textgen-webui
You can use the library of this repo also for scripts. Within the quip# folder, after installing the library, use this command:
python interactive_gen.py --hf_path path_to_the_2bitmodel --max_length 500
License The Yi series models are fully open for academic research and free commercial usage with permission via applications. All usage must adhere to the Model License Agreement 2.0. To apply for the official commercial license, please contact us ( [email protected] ).
Runs of KnutJaegersberg Tess-M-34B-2bit on huggingface.co
13
Total runs
0
24-hour runs
0
3-day runs
-2
7-day runs
7
30-day runs
More Information About Tess-M-34B-2bit huggingface.co Model
Url of Tess-M-34B-2bit
Tess-M-34B-2bit huggingface.co Url
Provider of Tess-M-34B-2bit huggingface.co
Other API from KnutJaegersberg
Updated:March 08 2024
Total runs:
1.4K
Run Growth:
-291
Growth Rate:
-20.61%
Total runs:
1.3K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.2K
Run Growth:
-299
Growth Rate:
-24.59%
Total runs:
1.2K
Run Growth:
-157
Growth Rate:
-13.06%
Total runs:
1.0K
Run Growth:
97
Growth Rate:
9.32%
Total runs:
991
Run Growth:
983
Growth Rate:
99.19%
Total runs:
850
Run Growth:
0
Growth Rate:
0.00%
Total runs:
825
Run Growth:
235
Growth Rate:
28.48%
Total runs:
399
Run Growth:
-428
Growth Rate:
-107.27%
Total runs:
392
Run Growth:
-423
Growth Rate:
-107.91%
Total runs:
348
Run Growth:
0
Growth Rate:
0.00%
Total runs:
266
Run Growth:
232
Growth Rate:
87.22%
Total runs:
251
Run Growth:
72
Growth Rate:
28.24%
Total runs:
250
Run Growth:
161
Growth Rate:
64.92%
Total runs:
240
Run Growth:
46
Growth Rate:
19.01%
Total runs:
239
Run Growth:
44
Growth Rate:
18.26%
Total runs:
236
Run Growth:
-235
Growth Rate:
-99.58%
Total runs:
235
Run Growth:
37
Growth Rate:
15.61%
Total runs:
232
Run Growth:
57
Growth Rate:
24.36%
Total runs:
229
Run Growth:
-248
Growth Rate:
-108.30%
Total runs:
227
Run Growth:
-245
Growth Rate:
-107.93%
Total runs:
221
Run Growth:
-252
Growth Rate:
-114.03%
Total runs:
220
Run Growth:
-254
Growth Rate:
-115.45%
Total runs:
217
Run Growth:
82
Growth Rate:
37.44%
Total runs:
213
Run Growth:
-206
Growth Rate:
-96.71%
Total runs:
212
Run Growth:
77
Growth Rate:
35.98%
Total runs:
199
Run Growth:
16
Growth Rate:
8.38%
Total runs:
197
Run Growth:
150
Growth Rate:
82.42%
Total runs:
193
Run Growth:
8
Growth Rate:
4.17%
Total runs:
190
Run Growth:
0
Growth Rate:
0.00%
Total runs:
169
Run Growth:
0
Growth Rate:
0.00%
Total runs:
147
Run Growth:
4
Growth Rate:
2.67%
Total runs:
135
Run Growth:
-47
Growth Rate:
-34.81%
Total runs:
133
Run Growth:
67
Growth Rate:
50.38%
Total runs:
122
Run Growth:
38
Growth Rate:
31.93%
Total runs:
115
Run Growth:
-25
Growth Rate:
-21.55%
Total runs:
102
Run Growth:
39
Growth Rate:
38.24%
Total runs:
98
Run Growth:
-32
Growth Rate:
-31.68%
Total runs:
96
Run Growth:
-14
Growth Rate:
-14.58%
Total runs:
92
Run Growth:
92
Growth Rate:
100.00%
Total runs:
83
Run Growth:
-27
Growth Rate:
-32.53%
Total runs:
81
Run Growth:
-33
Growth Rate:
-37.08%
Total runs:
78
Run Growth:
-6
Growth Rate:
-8.22%
Total runs:
77
Run Growth:
-10
Growth Rate:
-12.99%
Total runs:
77
Run Growth:
-7
Growth Rate:
-9.72%
Total runs:
75
Run Growth:
43
Growth Rate:
57.33%
Total runs:
74
Run Growth:
10
Growth Rate:
13.70%
Total runs:
73
Run Growth:
-36
Growth Rate:
-49.32%
Total runs:
70
Run Growth:
-9
Growth Rate:
-13.04%
Total runs:
69
Run Growth:
-11
Growth Rate:
-15.94%
Total runs:
68
Run Growth:
0
Growth Rate:
0.00%
Total runs:
66
Run Growth:
20
Growth Rate:
30.30%
Total runs:
61
Run Growth:
-54
Growth Rate:
-88.52%
Total runs:
60
Run Growth:
-57
Growth Rate:
-95.00%
Total runs:
58
Run Growth:
-54
Growth Rate:
-93.10%
Total runs:
54
Run Growth:
-59
Growth Rate:
-113.46%
Total runs:
54
Run Growth:
-29
Growth Rate:
-53.70%
Total runs:
47
Run Growth:
0
Growth Rate:
0.00%
Total runs:
47
Run Growth:
35
Growth Rate:
74.47%
Total runs:
44
Run Growth:
22
Growth Rate:
50.00%
Total runs:
42
Run Growth:
-9
Growth Rate:
-21.43%
Total runs:
38
Run Growth:
25
Growth Rate:
65.79%
Total runs:
30
Run Growth:
14
Growth Rate:
46.67%
Total runs:
29
Run Growth:
-7
Growth Rate:
-25.93%
Total runs:
29
Run Growth:
11
Growth Rate:
37.93%
Total runs:
27
Run Growth:
15
Growth Rate:
55.56%
Total runs:
26
Run Growth:
4
Growth Rate:
17.39%
Total runs:
24
Run Growth:
7
Growth Rate:
29.17%
Total runs:
22
Run Growth:
-7
Growth Rate:
-31.82%
Total runs:
22
Run Growth:
-2
Growth Rate:
-9.52%
Total runs:
21
Run Growth:
2
Growth Rate:
9.52%
Total runs:
20
Run Growth:
-16
Growth Rate:
-80.00%
Total runs:
20
Run Growth:
12
Growth Rate:
60.00%
Total runs:
20
Run Growth:
6
Growth Rate:
30.00%
Total runs:
19
Run Growth:
9
Growth Rate:
45.00%
Total runs:
18
Run Growth:
9
Growth Rate:
47.37%
Total runs:
18
Run Growth:
13
Growth Rate:
72.22%
Total runs:
18
Run Growth:
4
Growth Rate:
22.22%
Total runs:
18
Run Growth:
5
Growth Rate:
33.33%
Total runs:
18
Run Growth:
3
Growth Rate:
16.67%
Total runs:
18
Run Growth:
-3
Growth Rate:
-16.67%
Total runs:
17
Run Growth:
-2
Growth Rate:
-11.76%
Total runs:
17
Run Growth:
0
Growth Rate:
0.00%
Total runs:
17
Run Growth:
15
Growth Rate:
88.24%
Total runs:
17
Run Growth:
-2
Growth Rate:
-11.76%
Total runs:
16
Run Growth:
-1
Growth Rate:
-6.25%
Total runs:
16
Run Growth:
6
Growth Rate:
37.50%
Total runs:
15
Run Growth:
1
Growth Rate:
6.67%
Total runs:
15
Run Growth:
11
Growth Rate:
73.33%
Total runs:
14
Run Growth:
7
Growth Rate:
50.00%