Total runs:
2.5K
Run Growth:
220
Growth Rate:
8.86%
Sponsored by
APIMart
Locutusque / Hercules-5.0-Qwen2-7B
Model's Last Updated: July 04 2024
text-generation
Introduction of Hercules-5.0-Qwen2-7B
Model Details of Hercules-5.0-Qwen2-7B
Model Card: Hercules-5.0-Qwen2-7B
Model Description
Locutusque/Hercules-5.0-Qwen2-7B is a fine-tuned language model derived from Qwen2-7B. It is specifically designed to excel in instruction following, function calls, and conversational interactions across various scientific and technical domains. This fine-tuning has hercules-v5.0 with enhanced abilities in:
- Complex Instruction Following: Understanding and accurately executing multi-step instructions, even those involving specialized terminology.
- Function Calling: Seamlessly interpreting and executing function calls, providing appropriate input and output values.
- Domain-Specific Knowledge: Engaging in informative and educational conversations about Biology, Chemistry, Physics, Mathematics, Medicine, Computer Science, and more.
This model was fine-tuned using my TPU-Alignment repository. https://github.com/Locutusque/TPU-Alignment
Join my discord server: https://discord.com/invite/vrGheTUFrm
Intended Uses & Potential Bias
Locutusque/Hercules-5.0-Qwen2-7B is well-suited to the following applications:
- Specialized Chatbots: Creating knowledgeable chatbots and conversational agents in scientific and technical fields.
- Instructional Assistants: Supporting users with educational and step-by-step guidance in various disciplines.
- Code Generation and Execution: Facilitating code execution through function calls, aiding in software development and prototyping.
Limitations and Risks
- Toxicity: The dataset contains toxic or harmful examples.
- Hallucinations and Factual Errors: Like other language models, Locutusque/Hercules-5.0-Qwen2-7B may generate incorrect or misleading information, especially in specialized domains where it lacks sufficient expertise.
- Potential for Misuse: The ability to engage in technical conversations and execute function calls could be misused for malicious purposes.
Training Procedure
- This model was trained on 8 kaggle TPUs, using torch xla SPMD for high MXU efficiency. There was no expense on my end (meaning you can reproduce this too!)
- A learning rate of 5e-6 with the Adam optimizer. A linear scheduler was used, with an end factor of 0.1.
- No mixed precision was used, with the default dtype being bfloat16.
- A total batch size of 64 was used.
- Trained on all examples of Hercules-v5.0 for 1 epoch
- No model parameters were frozen and no quantization was used.
-
This model was trained on OpenAI's ChatML prompt format. Because this model has function calling capabilities, the prompt format is slightly different, here's what it would look like:
<|im_start|>system\n{message}<|im_end|>\n<|im_start|>user\n{user message}<|im_end|>\n<|im_start|>call\n{function call message}<|im_end|>\n<|im_start|>function\n{function response message}<|im_end|>\n<|im_start|>assistant\n{assistant message}</s>
This model was fine-tuned using my TPU-Alignment repository. https://github.com/Locutusque/TPU-Alignment
Runs of Locutusque Hercules-5.0-Qwen2-7B on huggingface.co
33
Total runs
0
24-hour runs
0
3-day runs
-6
7-day runs
1
30-day runs
More Information About Hercules-5.0-Qwen2-7B huggingface.co Model
Url of Hercules-5.0-Qwen2-7B
Hercules-5.0-Qwen2-7B huggingface.co Url
Provider of Hercules-5.0-Qwen2-7B huggingface.co
Other API from Locutusque
Updated:August 01 2023
Total runs:
1.1K
Run Growth:
25
Growth Rate:
2.33%
Total runs:
1.1K
Run Growth:
82
Growth Rate:
7.72%
Total runs:
1.1K
Run Growth:
-1.0K
Growth Rate:
-96.40%
Total runs:
1.0K
Run Growth:
-240
Growth Rate:
-22.90%
Total runs:
1.0K
Run Growth:
85
Growth Rate:
8.24%
Total runs:
1.0K
Run Growth:
60
Growth Rate:
5.90%
Total runs:
995
Run Growth:
-1.3K
Growth Rate:
-125.73%
Total runs:
866
Run Growth:
287
Growth Rate:
33.14%
Total runs:
845
Run Growth:
288
Growth Rate:
34.08%
Total runs:
832
Run Growth:
789
Growth Rate:
94.83%
Total runs:
247
Run Growth:
-55
Growth Rate:
-22.27%
Total runs:
229
Run Growth:
156
Growth Rate:
68.12%
Total runs:
157
Run Growth:
148
Growth Rate:
94.27%
Total runs:
145
Run Growth:
0
Growth Rate:
0.00%
Total runs:
111
Run Growth:
27
Growth Rate:
24.32%
Total runs:
108
Run Growth:
-250
Growth Rate:
-231.48%
Total runs:
101
Run Growth:
31
Growth Rate:
30.69%
Total runs:
99
Run Growth:
8
Growth Rate:
8.08%
Total runs:
88
Run Growth:
4
Growth Rate:
4.55%
Total runs:
85
Run Growth:
-5
Growth Rate:
-5.75%
Total runs:
77
Run Growth:
2
Growth Rate:
2.60%
Total runs:
75
Run Growth:
-3
Growth Rate:
-4.00%
Total runs:
73
Run Growth:
-1
Growth Rate:
-1.37%
Total runs:
73
Run Growth:
-2
Growth Rate:
-2.74%
Total runs:
72
Run Growth:
-1
Growth Rate:
-1.39%
Total runs:
72
Run Growth:
-4
Growth Rate:
-5.56%
Total runs:
68
Run Growth:
2
Growth Rate:
2.94%
Total runs:
68
Run Growth:
32
Growth Rate:
47.06%
Total runs:
67
Run Growth:
-5
Growth Rate:
-7.46%
Total runs:
67
Run Growth:
-4
Growth Rate:
-5.97%
Total runs:
67
Run Growth:
-11
Growth Rate:
-16.42%
Total runs:
66
Run Growth:
-10
Growth Rate:
-15.15%
Total runs:
61
Run Growth:
-3
Growth Rate:
-4.92%
Total runs:
60
Run Growth:
-7
Growth Rate:
-11.67%
Total runs:
59
Run Growth:
-7
Growth Rate:
-11.86%
Total runs:
58
Run Growth:
35
Growth Rate:
61.40%
Total runs:
55
Run Growth:
-9
Growth Rate:
-16.36%
Total runs:
47
Run Growth:
2
Growth Rate:
4.35%
Total runs:
45
Run Growth:
1
Growth Rate:
2.33%
Total runs:
43
Run Growth:
22
Growth Rate:
51.16%
Total runs:
39
Run Growth:
2
Growth Rate:
5.56%
Total runs:
38
Run Growth:
34
Growth Rate:
89.47%
Total runs:
37
Run Growth:
-3
Growth Rate:
-8.11%
Total runs:
36
Run Growth:
26
Growth Rate:
72.22%
Total runs:
36
Run Growth:
1
Growth Rate:
2.63%
Total runs:
36
Run Growth:
19
Growth Rate:
52.78%
Total runs:
34
Run Growth:
23
Growth Rate:
71.88%
Total runs:
34
Run Growth:
8
Growth Rate:
22.86%
Total runs:
32
Run Growth:
-4
Growth Rate:
-12.50%
Total runs:
26
Run Growth:
0
Growth Rate:
0.00%
Total runs:
23
Run Growth:
6
Growth Rate:
26.09%
Total runs:
22
Run Growth:
-4
Growth Rate:
-18.18%
Total runs:
22
Run Growth:
15
Growth Rate:
68.18%
Total runs:
19
Run Growth:
0
Growth Rate:
0.00%
Total runs:
16
Run Growth:
12
Growth Rate:
75.00%
Total runs:
16
Run Growth:
-1
Growth Rate:
-6.25%
Total runs:
14
Run Growth:
-1
Growth Rate:
-7.14%
Total runs:
14
Run Growth:
-4
Growth Rate:
-28.57%
Total runs:
12
Run Growth:
4
Growth Rate:
33.33%
Total runs:
12
Run Growth:
8
Growth Rate:
66.67%
Total runs:
11
Run Growth:
11
Growth Rate:
100.00%
Total runs:
11
Run Growth:
-4
Growth Rate:
-36.36%
Total runs:
10
Run Growth:
7
Growth Rate:
70.00%
Total runs:
10
Run Growth:
2
Growth Rate:
20.00%
Total runs:
10
Run Growth:
-4
Growth Rate:
-40.00%
Total runs:
10
Run Growth:
2
Growth Rate:
20.00%
Total runs:
9
Run Growth:
-20
Growth Rate:
-222.22%
Total runs:
9
Run Growth:
5
Growth Rate:
55.56%
Total runs:
7
Run Growth:
-22
Growth Rate:
-314.29%
Total runs:
7
Run Growth:
-1
Growth Rate:
-14.29%
Total runs:
6
Run Growth:
-18
Growth Rate:
-300.00%
Total runs:
6
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
1
Growth Rate:
20.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
4
Growth Rate:
100.00%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
-1
Growth Rate:
-33.33%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%
Total runs:
3
Run Growth:
3
Growth Rate:
100.00%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
1
Growth Rate:
50.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%