Locutusque / lr-experiment1-7B

huggingface.co
Total runs: 101
24-hour runs: 0
7-day runs: 0
30-day runs: 31
Model's Last Updated: March 12 2024
text-generation

Introduction of lr-experiment1-7B

Model Details of lr-experiment1-7B

lr-experiment1-7B

The lr-experiment model series is a research project I'm conducting that I will be using to determine the best learning rate to use while fine-tuning Mistral. This model uses a learning rate of 2e-5 with a cosine scheduler and no warmup steps.

I used Locutusque/Hercules-2.0-Mistral-7B as a base model, and further fine-tuned it on CollectiveCognition/chats-data-2023-09-22 using QLoRA for 3 epochs. I will be keeping track of evaluation results, and will comparing it to upcoming models.

Evals

Tasks Version Filter n-shot Metric Value Stderr
agieval_nous N/A none None acc 0.3645 ± 0.0093
none None acc_norm 0.3468 ± 0.0092
- agieval_aqua_rat 1 none None acc 0.2283 ± 0.0264
none None acc_norm 0.2283 ± 0.0264
- agieval_logiqa_en 1 none None acc 0.2965 ± 0.0179
none None acc_norm 0.3303 ± 0.0184
- agieval_lsat_ar 1 none None acc 0.2217 ± 0.0275
none None acc_norm 0.1783 ± 0.0253
- agieval_lsat_lr 1 none None acc 0.4039 ± 0.0217
none None acc_norm 0.3686 ± 0.0214
- agieval_lsat_rc 1 none None acc 0.4870 ± 0.0305
none None acc_norm 0.4424 ± 0.0303
- agieval_sat_en 1 none None acc 0.6408 ± 0.0335
none None acc_norm 0.5971 ± 0.0343
- agieval_sat_en_without_passage 1 none None acc 0.3932 ± 0.0341
none None acc_norm 0.3835 ± 0.0340
- agieval_sat_math 1 none None acc 0.3455 ± 0.0321
none None acc_norm 0.2727 ± 0.0301
Groups Version Filter n-shot Metric Value Stderr
agieval_nous N/A none None acc 0.3645 ± 0.0093
none None acc_norm 0.3468 ± 0.0092

Runs of Locutusque lr-experiment1-7B on huggingface.co

101
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
31
30-day runs

More Information About lr-experiment1-7B huggingface.co Model

More lr-experiment1-7B license Visit here:

https://choosealicense.com/licenses/apache-2.0

lr-experiment1-7B huggingface.co

lr-experiment1-7B huggingface.co is an AI model on huggingface.co that provides lr-experiment1-7B's model effect (), which can be used instantly with this Locutusque lr-experiment1-7B model. huggingface.co supports a free trial of the lr-experiment1-7B model, and also provides paid use of the lr-experiment1-7B. Support call lr-experiment1-7B model through api, including Node.js, Python, http.

lr-experiment1-7B huggingface.co Url

https://huggingface.co/Locutusque/lr-experiment1-7B

Locutusque lr-experiment1-7B online free

lr-experiment1-7B huggingface.co is an online trial and call api platform, which integrates lr-experiment1-7B's modeling effects, including api services, and provides a free online trial of lr-experiment1-7B, you can try lr-experiment1-7B online for free by clicking the link below.

Locutusque lr-experiment1-7B online free url in huggingface.co:

https://huggingface.co/Locutusque/lr-experiment1-7B

lr-experiment1-7B install

lr-experiment1-7B is an open source model from GitHub that offers a free installation service, and any user can find lr-experiment1-7B on GitHub to install. At the same time, huggingface.co provides the effect of lr-experiment1-7B install, users can directly use lr-experiment1-7B installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

lr-experiment1-7B install url in huggingface.co:

https://huggingface.co/Locutusque/lr-experiment1-7B

Url of lr-experiment1-7B

lr-experiment1-7B huggingface.co Url

Provider of lr-experiment1-7B huggingface.co

Locutusque
ORGANIZATIONS

Other API from Locutusque