Total runs:
8.5K
Run Growth:
438
Growth Rate:
5.14%
Sponsored by
iMean AI Trip Planner
turboderp / turbcat-instruct-72b
Model's Last Updated: July 19 2024
text-generation
Introduction of turbcat-instruct-72b
Model Details of turbcat-instruct-72b
Turbcat 72b
Release notes
This is a direct upgrade over cat 70B, with 2x the dataset size(2GB-> 5GB), added Chinese support with quality on par with the original English dataset. The medical COT portion of the dataset has been sponsored by steelskull, and the action packed character play portion was donated by Gryphe's(aesir dataset). Note that 8b is based on llama3 with limited Chinese support due to base model choice. The chat format in 8b is llama3. The 72b has more comprehensive Chinese support and the format will be chatml.
Data Generation
In addition to the specified fortifications above, the data generation process is largely the same. Except for added Chinese Ph. D. Entrance exam, Traditional Chinese and Chinese story telling data.
Special Highlights
- 20 postdocs (10 Chinese, 10 English speaking doctors specialized in computational biology, biomed, biophysics and biochemistry)participated in the annotation process.
- GRE and MCAT/Kaoyan questions were manually answered by the participants using strictly COT and BERT judges producing embeddings were trained based on the provided annotation. For an example of BERT embedding visualization and scoring, please refer to https://huggingface.co/turboderp/Cat-Llama-3-70B-instruct
- Initial support of roleplay as api usage. When roleplaying as an API or function, the model does not produce irrelevant content that's not specified by the system prompt.
Task coverage
Chinese tasks on par with English data
For the Chinese portion of the dataset, we strictly kept its distribution and quality comparable to the English counterpart, as visualized by the close distance of the doublets. The overall QC is visualized by PCA after bert embedding
Individual tasks Quality Checked by doctors
For each cluster, we QC using BERT embeddings on an umap:
The outliers have been manually checked by doctors.
Thirdparty dataset
Thanks to the following people for their tremendous support for dataset generation:
- steelskull for the medical COT dataset with gpt4o
- Gryphe for the wonderful action packed dataset
- Turbca for being turbca
Prompt format for 8b:
llama3 Example raw prompt:
<|begin_of_text|><|start_header_id|>system<|end_header_id|>
CatGPT really likes its new cat ears and ends every message with Nyan_<|eot_id|><|start_header_id|>user<|end_header_id|>
CatA: pats CatGPT cat ears<|eot_id|><|start_header_id|>assistant<|end_header_id|>
CatGPT:
Prompt format for 72b:
chatml Example raw prompt:
<|im_start|>system
CatGPT really likes its new cat ears and ends every message with Nyan_<|im_end|>
<|im_start|>user
CatA: pats CatGPT cat ears<|im_end|>
<|im_start|>assistant
CatGPT:
Support
Please join https://discord.gg/DwGz54Mz for model support
Runs of turboderp turbcat-instruct-72b on huggingface.co
12
Total runs
0
24-hour runs
-2
3-day runs
-1
7-day runs
-1
30-day runs
More Information About turbcat-instruct-72b huggingface.co Model
Url of turbcat-instruct-72b
turbcat-instruct-72b huggingface.co Url
Provider of turbcat-instruct-72b huggingface.co
Other API from turboderp
Updated:May 09 2024
Total runs:
5.3K
Run Growth:
5.0K
Growth Rate:
93.29%
Total runs:
4.4K
Run Growth:
4.3K
Growth Rate:
99.98%
Total runs:
3.2K
Run Growth:
2.6K
Growth Rate:
82.61%
Total runs:
1.9K
Run Growth:
1.8K
Growth Rate:
97.11%
Total runs:
855
Run Growth:
-23
Growth Rate:
-2.69%
Total runs:
449
Run Growth:
449
Growth Rate:
100.00%
Total runs:
348
Run Growth:
-143
Growth Rate:
-41.09%
Total runs:
306
Run Growth:
-203
Growth Rate:
-66.34%
Total runs:
206
Run Growth:
-368
Growth Rate:
-178.64%
Total runs:
194
Run Growth:
-18
Growth Rate:
-9.28%
Total runs:
192
Run Growth:
-344
Growth Rate:
-179.17%
Total runs:
162
Run Growth:
32
Growth Rate:
19.75%
Total runs:
160
Run Growth:
-181
Growth Rate:
-113.13%
Total runs:
137
Run Growth:
-52
Growth Rate:
-37.96%
Total runs:
133
Run Growth:
-71
Growth Rate:
-53.38%
Total runs:
109
Run Growth:
109
Growth Rate:
100.00%
Total runs:
100
Run Growth:
100
Growth Rate:
100.00%
Total runs:
77
Run Growth:
63
Growth Rate:
81.82%
Total runs:
71
Run Growth:
71
Growth Rate:
100.00%
Total runs:
64
Run Growth:
-65
Growth Rate:
-101.56%
Total runs:
60
Run Growth:
0
Growth Rate:
0.00%
Total runs:
55
Run Growth:
55
Growth Rate:
100.00%
Total runs:
49
Run Growth:
39
Growth Rate:
79.59%
Total runs:
49
Run Growth:
44
Growth Rate:
89.80%
Total runs:
41
Run Growth:
13
Growth Rate:
31.71%
Total runs:
40
Run Growth:
30
Growth Rate:
75.00%
Total runs:
40
Run Growth:
-6
Growth Rate:
-15.00%
Total runs:
40
Run Growth:
-33
Growth Rate:
-82.50%
Total runs:
39
Run Growth:
-1
Growth Rate:
-2.56%
Total runs:
37
Run Growth:
18
Growth Rate:
48.65%
Total runs:
34
Run Growth:
3
Growth Rate:
8.82%
Total runs:
30
Run Growth:
0
Growth Rate:
0.00%
Total runs:
29
Run Growth:
-2
Growth Rate:
-6.90%
Total runs:
28
Run Growth:
0
Growth Rate:
0.00%
Total runs:
27
Run Growth:
5
Growth Rate:
18.52%
Total runs:
26
Run Growth:
0
Growth Rate:
0.00%
Total runs:
26
Run Growth:
2
Growth Rate:
7.69%
Total runs:
25
Run Growth:
23
Growth Rate:
92.00%
Total runs:
25
Run Growth:
0
Growth Rate:
0.00%
Total runs:
25
Run Growth:
-9
Growth Rate:
-36.00%
Total runs:
24
Run Growth:
0
Growth Rate:
0.00%
Total runs:
24
Run Growth:
10
Growth Rate:
41.67%
Total runs:
22
Run Growth:
0
Growth Rate:
0.00%
Total runs:
21
Run Growth:
-10
Growth Rate:
-47.62%
Total runs:
20
Run Growth:
-7
Growth Rate:
-35.00%
Total runs:
20
Run Growth:
15
Growth Rate:
88.24%
Total runs:
20
Run Growth:
20
Growth Rate:
100.00%
Total runs:
19
Run Growth:
18
Growth Rate:
94.74%
Total runs:
17
Run Growth:
5
Growth Rate:
29.41%
Total runs:
17
Run Growth:
2
Growth Rate:
11.76%
Total runs:
16
Run Growth:
16
Growth Rate:
100.00%
Total runs:
15
Run Growth:
10
Growth Rate:
66.67%
Total runs:
15
Run Growth:
15
Growth Rate:
100.00%
Total runs:
14
Run Growth:
0
Growth Rate:
0.00%
Total runs:
14
Run Growth:
-12
Growth Rate:
-85.71%
Total runs:
14
Run Growth:
10
Growth Rate:
71.43%
Total runs:
14
Run Growth:
10
Growth Rate:
71.43%
Total runs:
13
Run Growth:
1
Growth Rate:
7.14%
Total runs:
13
Run Growth:
-7
Growth Rate:
-53.85%
Total runs:
13
Run Growth:
0
Growth Rate:
0.00%
Total runs:
13
Run Growth:
0
Growth Rate:
0.00%
Total runs:
12
Run Growth:
12
Growth Rate:
100.00%
Total runs:
12
Run Growth:
5
Growth Rate:
45.45%
Total runs:
12
Run Growth:
8
Growth Rate:
66.67%
Total runs:
12
Run Growth:
8
Growth Rate:
72.73%
Total runs:
11
Run Growth:
10
Growth Rate:
90.91%
Total runs:
11
Run Growth:
-8
Growth Rate:
-72.73%
Total runs:
11
Run Growth:
-1
Growth Rate:
-9.09%
Total runs:
11
Run Growth:
6
Growth Rate:
50.00%
Total runs:
10
Run Growth:
-13
Growth Rate:
-130.00%
Total runs:
10
Run Growth:
-8
Growth Rate:
-66.67%
Total runs:
10
Run Growth:
8
Growth Rate:
80.00%
Total runs:
10
Run Growth:
4
Growth Rate:
40.00%
Total runs:
9
Run Growth:
3
Growth Rate:
33.33%
Total runs:
9
Run Growth:
2
Growth Rate:
22.22%
Total runs:
8
Run Growth:
6
Growth Rate:
75.00%
Total runs:
8
Run Growth:
7
Growth Rate:
87.50%
Total runs:
7
Run Growth:
6
Growth Rate:
85.71%
Total runs:
7
Run Growth:
6
Growth Rate:
100.00%
Total runs:
7
Run Growth:
-2
Growth Rate:
-28.57%
Total runs:
6
Run Growth:
6
Growth Rate:
100.00%