wandb / gemma-7b-zephyr-dpo

huggingface.co
Total runs: 22
24-hour runs: 0
7-day runs: -1
30-day runs: -2
Model's Last Updated: March 04 2024
text-generation

Introduction of gemma-7b-zephyr-dpo

Model Details of gemma-7b-zephyr-dpo

Visualize in Weights & Biases

Gemma 7B Zephyr DPO

The Zephyr DPO recipe applied on top of SFT finetuned Gemma 7B

Model description
  • Model type: A 8.5B parameter GPT-like model fine-tuned on a mix of publicly available, synthetic datasets.
  • Language(s) (NLP): Primarily English
  • Finetuned from model: wandb/gemma-7b-zephyr-sft
Recipe

We trained using the DPO script in alignment handbook recipe and logging to W&B

Visit the W&B workspace here

License

This model has the same license as the original Gemma model collection

Compute provided by Lambda Labs - 8xA100 80GB node

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 61.62
AI2 Reasoning Challenge (25-Shot) 60.84
HellaSwag (10-Shot) 80.44
MMLU (5-Shot) 60.60
TruthfulQA (0-shot) 42.48
Winogrande (5-shot) 75.37
GSM8k (5-shot) 49.96

Runs of wandb gemma-7b-zephyr-dpo on huggingface.co

22
Total runs
0
24-hour runs
2
3-day runs
-1
7-day runs
-2
30-day runs

More Information About gemma-7b-zephyr-dpo huggingface.co Model

More gemma-7b-zephyr-dpo license Visit here:

https://choosealicense.com/licenses/gemma-terms-of-use

gemma-7b-zephyr-dpo huggingface.co

gemma-7b-zephyr-dpo huggingface.co is an AI model on huggingface.co that provides gemma-7b-zephyr-dpo's model effect (), which can be used instantly with this wandb gemma-7b-zephyr-dpo model. huggingface.co supports a free trial of the gemma-7b-zephyr-dpo model, and also provides paid use of the gemma-7b-zephyr-dpo. Support call gemma-7b-zephyr-dpo model through api, including Node.js, Python, http.

gemma-7b-zephyr-dpo huggingface.co Url

https://huggingface.co/wandb/gemma-7b-zephyr-dpo

wandb gemma-7b-zephyr-dpo online free

gemma-7b-zephyr-dpo huggingface.co is an online trial and call api platform, which integrates gemma-7b-zephyr-dpo's modeling effects, including api services, and provides a free online trial of gemma-7b-zephyr-dpo, you can try gemma-7b-zephyr-dpo online for free by clicking the link below.

wandb gemma-7b-zephyr-dpo online free url in huggingface.co:

https://huggingface.co/wandb/gemma-7b-zephyr-dpo

gemma-7b-zephyr-dpo install

gemma-7b-zephyr-dpo is an open source model from GitHub that offers a free installation service, and any user can find gemma-7b-zephyr-dpo on GitHub to install. At the same time, huggingface.co provides the effect of gemma-7b-zephyr-dpo install, users can directly use gemma-7b-zephyr-dpo installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

gemma-7b-zephyr-dpo install url in huggingface.co:

https://huggingface.co/wandb/gemma-7b-zephyr-dpo

Url of gemma-7b-zephyr-dpo

gemma-7b-zephyr-dpo huggingface.co Url

Provider of gemma-7b-zephyr-dpo huggingface.co

wandb
ORGANIZATIONS

Other API from wandb

huggingface.co

Total runs: 75
Run Growth: 0
Growth Rate: 0.00%
Updated:November 29 2024
huggingface.co

Total runs: 9
Run Growth: 1
Growth Rate: 10.00%
Updated:November 22 2024
huggingface.co

Total runs: 2
Run Growth: -6
Growth Rate: -300.00%
Updated:November 29 2024