The lr-experiment model series is a research project I'm conducting that I will be using to determine the best learning rate to use while fine-tuning Mistral. This model uses a learning rate of 2e-5 with a cosine scheduler and no warmup steps.
I used Locutusque/Hercules-2.0-Mistral-7B as a base model, and further fine-tuned it on CollectiveCognition/chats-data-2023-09-22 using QLoRA for 3 epochs. I will be keeping track of evaluation results, and will comparing it to upcoming models.
Evals
Tasks
Version
Filter
n-shot
Metric
Value
Stderr
agieval_nous
N/A
none
None
acc
0.3645
±
0.0093
none
None
acc_norm
0.3468
±
0.0092
- agieval_aqua_rat
1
none
None
acc
0.2283
±
0.0264
none
None
acc_norm
0.2283
±
0.0264
- agieval_logiqa_en
1
none
None
acc
0.2965
±
0.0179
none
None
acc_norm
0.3303
±
0.0184
- agieval_lsat_ar
1
none
None
acc
0.2217
±
0.0275
none
None
acc_norm
0.1783
±
0.0253
- agieval_lsat_lr
1
none
None
acc
0.4039
±
0.0217
none
None
acc_norm
0.3686
±
0.0214
- agieval_lsat_rc
1
none
None
acc
0.4870
±
0.0305
none
None
acc_norm
0.4424
±
0.0303
- agieval_sat_en
1
none
None
acc
0.6408
±
0.0335
none
None
acc_norm
0.5971
±
0.0343
- agieval_sat_en_without_passage
1
none
None
acc
0.3932
±
0.0341
none
None
acc_norm
0.3835
±
0.0340
- agieval_sat_math
1
none
None
acc
0.3455
±
0.0321
none
None
acc_norm
0.2727
±
0.0301
Groups
Version
Filter
n-shot
Metric
Value
Stderr
agieval_nous
N/A
none
None
acc
0.3645
±
0.0093
none
None
acc_norm
0.3468
±
0.0092
Runs of Locutusque lr-experiment1-7B on huggingface.co
101
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
31
30-day runs
More Information About lr-experiment1-7B huggingface.co Model
lr-experiment1-7B huggingface.co is an AI model on huggingface.co that provides lr-experiment1-7B's model effect (), which can be used instantly with this Locutusque lr-experiment1-7B model. huggingface.co supports a free trial of the lr-experiment1-7B model, and also provides paid use of the lr-experiment1-7B. Support call lr-experiment1-7B model through api, including Node.js, Python, http.
lr-experiment1-7B huggingface.co is an online trial and call api platform, which integrates lr-experiment1-7B's modeling effects, including api services, and provides a free online trial of lr-experiment1-7B, you can try lr-experiment1-7B online for free by clicking the link below.
Locutusque lr-experiment1-7B online free url in huggingface.co:
lr-experiment1-7B is an open source model from GitHub that offers a free installation service, and any user can find lr-experiment1-7B on GitHub to install. At the same time, huggingface.co provides the effect of lr-experiment1-7B install, users can directly use lr-experiment1-7B installed effect in huggingface.co for debugging and trial. It also supports api for free installation.