Sponsored by
APIMart
Undi95 / Llama2-13B-no_robots-alpaca-lora
Model's Last Updated: November 18 2023
text-generation
Introduction of Llama2-13B-no_robots-alpaca-lora
Model Details of Llama2-13B-no_robots-alpaca-lora
no_robots-alpaca
This lora was trained with Doctor-Shotgun/no-robots-sharegpt dataset on TheBloke/Llama-2-13B-fp16 . It achieves the following results on the evaluation set:
- Loss: 1.6087
Model description
The LoRA was trained on Doctor-Shotgun/no-robots-sharegpt , a ShareGPT converted dataset from the OG HuggingFaceH4/no_robots but with Alpaca prompting.
Prompt template: Alpaca
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Response:
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.00065
- train_batch_size: 2
- eval_batch_size: 2
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: constant
- lr_scheduler_warmup_steps: 10
- num_epochs: 2
Training results
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 1.5523 | 0.0 | 1 | 1.5476 |
| 1.2139 | 0.1 | 42 | 1.5008 |
| 1.6348 | 0.2 | 84 | 1.4968 |
| 1.6498 | 0.3 | 126 | 1.4962 |
| 1.5645 | 0.4 | 168 | 1.4983 |
| 1.6487 | 0.5 | 210 | 1.4981 |
| 1.6147 | 0.6 | 252 | 1.4965 |
| 1.3048 | 0.7 | 294 | 1.4973 |
| 1.6205 | 0.8 | 336 | 1.5007 |
| 1.6045 | 0.9 | 378 | 1.5003 |
| 1.5781 | 1.0 | 420 | 1.5013 |
| 1.4807 | 1.09 | 462 | 1.5492 |
| 1.0541 | 1.19 | 504 | 1.5596 |
| 1.2337 | 1.29 | 546 | 1.5789 |
| 0.9719 | 1.39 | 588 | 1.5859 |
| 1.2189 | 1.49 | 630 | 1.5959 |
| 1.2566 | 1.59 | 672 | 1.5968 |
| 0.7049 | 1.69 | 714 | 1.5987 |
| 1.2133 | 1.79 | 756 | 1.5907 |
| 1.0327 | 1.89 | 798 | 1.6087 |
Framework versions
- Transformers 4.34.1
- Pytorch 2.0.1+cu117
- Datasets 2.14.6
- Tokenizers 0.14.1
If you want to support me, you can here .
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 46.55 |
| ARC (25-shot) | 58.87 |
| HellaSwag (10-shot) | 82.43 |
| MMLU (5-shot) | 53.11 |
| TruthfulQA (0-shot) | 40.46 |
| Winogrande (5-shot) | 75.3 |
| GSM8K (5-shot) | 6.44 |
| DROP (3-shot) | 9.26 |
Runs of Undi95 Llama2-13B-no_robots-alpaca-lora on huggingface.co
188
Total runs
1
24-hour runs
1
3-day runs
3
7-day runs
93
30-day runs
More Information About Llama2-13B-no_robots-alpaca-lora huggingface.co Model
Url of Llama2-13B-no_robots-alpaca-lora
Llama2-13B-no_robots-alpaca-lora huggingface.co Url
Provider of Llama2-13B-no_robots-alpaca-lora huggingface.co
Other API from Undi95
Total runs:
876
Run Growth:
268
Growth Rate:
30.59%
Total runs:
804
Run Growth:
-245
Growth Rate:
-30.47%
Total runs:
802
Run Growth:
-251
Growth Rate:
-31.30%
Total runs:
800
Run Growth:
-229
Growth Rate:
-28.63%
Total runs:
729
Run Growth:
-253
Growth Rate:
-34.71%
Total runs:
719
Run Growth:
-277
Growth Rate:
-38.53%
Total runs:
717
Run Growth:
-225
Growth Rate:
-31.38%
Total runs:
713
Run Growth:
-252
Growth Rate:
-35.34%
Total runs:
704
Run Growth:
-258
Growth Rate:
-36.65%
Total runs:
691
Run Growth:
69
Growth Rate:
9.99%
Total runs:
563
Run Growth:
514
Growth Rate:
91.30%
Total runs:
532
Run Growth:
502
Growth Rate:
94.36%
Total runs:
386
Run Growth:
-11
Growth Rate:
-2.85%
Total runs:
312
Run Growth:
274
Growth Rate:
87.82%
Total runs:
310
Run Growth:
-63
Growth Rate:
-20.32%
Total runs:
284
Run Growth:
-27.0K
Growth Rate:
-9501.06%
Total runs:
249
Run Growth:
171
Growth Rate:
68.95%
Total runs:
197
Run Growth:
-825
Growth Rate:
-418.78%
Total runs:
190
Run Growth:
-155
Growth Rate:
-81.58%
Total runs:
182
Run Growth:
116
Growth Rate:
63.74%
Total runs:
158
Run Growth:
94
Growth Rate:
59.49%
Total runs:
157
Run Growth:
18
Growth Rate:
11.46%
Total runs:
153
Run Growth:
75
Growth Rate:
49.02%
Total runs:
147
Run Growth:
93
Growth Rate:
63.27%
Total runs:
146
Run Growth:
-449
Growth Rate:
-307.53%
Total runs:
141
Run Growth:
-469
Growth Rate:
-332.62%
Total runs:
141
Run Growth:
-26
Growth Rate:
-18.18%
Total runs:
141
Run Growth:
-477
Growth Rate:
-338.30%
Total runs:
138
Run Growth:
-23
Growth Rate:
-16.67%
Total runs:
138
Run Growth:
-60
Growth Rate:
-43.48%
Total runs:
138
Run Growth:
-96
Growth Rate:
-69.57%
Total runs:
134
Run Growth:
-322
Growth Rate:
-240.30%
Total runs:
119
Run Growth:
-82
Growth Rate:
-62.12%
Total runs:
130
Run Growth:
90
Growth Rate:
69.77%
Total runs:
123
Run Growth:
-314
Growth Rate:
-255.28%
Total runs:
122
Run Growth:
-477
Growth Rate:
-390.98%
Total runs:
122
Run Growth:
-34
Growth Rate:
-27.87%
Total runs:
120
Run Growth:
-485
Growth Rate:
-404.17%
Total runs:
110
Run Growth:
76
Growth Rate:
69.09%
Total runs:
106
Run Growth:
0
Growth Rate:
0.00%
Total runs:
104
Run Growth:
27
Growth Rate:
25.71%
Total runs:
99
Run Growth:
16
Growth Rate:
16.16%
Total runs:
97
Run Growth:
-70
Growth Rate:
-72.16%
Total runs:
97
Run Growth:
17
Growth Rate:
17.53%
Total runs:
95
Run Growth:
-354
Growth Rate:
-372.63%
Total runs:
93
Run Growth:
-45
Growth Rate:
-48.39%
Total runs:
93
Run Growth:
-6
Growth Rate:
-6.45%
Total runs:
86
Run Growth:
-3
Growth Rate:
-3.49%
Total runs:
86
Run Growth:
-108
Growth Rate:
-125.58%
Total runs:
85
Run Growth:
77
Growth Rate:
90.59%
Total runs:
84
Run Growth:
63
Growth Rate:
75.00%
Total runs:
84
Run Growth:
5
Growth Rate:
5.95%
Total runs:
83
Run Growth:
-6
Growth Rate:
-7.23%
Total runs:
82
Run Growth:
3
Growth Rate:
3.66%
Total runs:
74
Run Growth:
-41
Growth Rate:
-56.16%
Total runs:
72
Run Growth:
-1
Growth Rate:
-1.39%
Total runs:
70
Run Growth:
-26
Growth Rate:
-37.14%
Total runs:
70
Run Growth:
32
Growth Rate:
45.71%
Total runs:
69
Run Growth:
0
Growth Rate:
0.00%
Total runs:
68
Run Growth:
-35
Growth Rate:
-51.47%
Total runs:
67
Run Growth:
-40
Growth Rate:
-59.70%
Total runs:
63
Run Growth:
9
Growth Rate:
14.29%
Total runs:
62
Run Growth:
-27
Growth Rate:
-44.26%
Total runs:
61
Run Growth:
9
Growth Rate:
14.75%
Total runs:
61
Run Growth:
-14
Growth Rate:
-23.73%
Total runs:
57
Run Growth:
41
Growth Rate:
71.93%
Total runs:
56
Run Growth:
-165
Growth Rate:
-294.64%
Total runs:
55
Run Growth:
-31
Growth Rate:
-56.36%
Total runs:
55
Run Growth:
-9
Growth Rate:
-16.36%
Total runs:
55
Run Growth:
-35
Growth Rate:
-63.64%
Total runs:
54
Run Growth:
5
Growth Rate:
9.26%
Total runs:
53
Run Growth:
-13
Growth Rate:
-24.53%
Total runs:
53
Run Growth:
42
Growth Rate:
79.25%