QuantFactory / Llama-3-Instruct-8B-SimPO-ExPO-GGUF

huggingface.co
Total runs: 888
24-hour runs: 0
7-day runs: 0
30-day runs: 0
Model's Last Updated: June 04 2024
text-generation

Introduction of Llama-3-Instruct-8B-SimPO-ExPO-GGUF

Model Details of Llama-3-Instruct-8B-SimPO-ExPO-GGUF

Llama-3-Instruct-8B-SimPO-ExPO-GGUF

This is quantized version of chujiezheng/Llama-3-Instruct-8B-SimPO-ExPO created using llama.cpp

Model Description

The extrapolated (ExPO) model based on princeton-nlp/Llama-3-Instruct-8B-SimPO and meta-llama/Meta-Llama-3-8B-Instruct , as in the " Weak-to-Strong Extrapolation Expedites Alignment " paper.

Specifically, we obtain this model by extrapolating (alpha = 0.3) from the weights of the SFT and DPO/RLHF checkpoints, achieving superior alignment with human preference.

This extrapolated model achieves the 40.6% win rate and 45.8% LC win rate on AlpacaEval 2.0 , outperforming the original Llama-3-Instruct-8B-SimPO 's 40.5% and 44.7%, respectively.

Evaluation Results

Evaluation results on the AlpacaEval 2.0 benchmark (you can find the evaluation outputs on the official GitHub repo ):

Win Rate (Ori) LC Win Rate (Ori) Win Rate (+ ExPO) LC Win Rate (+ ExPO)
HuggingFaceH4/zephyr-7b-alpha 6.7% 10.0% 10.6% 13.6%
HuggingFaceH4/zephyr-7b-beta 10.2% 13.2% 11.1% 14.0%
berkeley-nest/Starling-LM-7B-alpha 15.0% 18.3% 18.2% 19.5%
Nexusflow/Starling-LM-7B-beta 26.6% 25.8% 29.6% 26.4%
snorkelai/Snorkel-Mistral-PairRM 24.7% 24.0% 28.8% 26.4%
RLHFlow/LLaMA3-iterative-DPO-final 29.2% 36.0% 32.7% 37.8%
internlm/internlm2-chat-1.8b 3.8% 4.0% 5.2% 4.3%
internlm/internlm2-chat-7b 20.5% 18.3% 28.1% 22.7%
internlm/internlm2-chat-20b 36.1% 24.9% 46.2% 27.2%
allenai/tulu-2-dpo-7b 8.5% 10.2% 11.5% 11.7%
allenai/tulu-2-dpo-13b 11.2% 15.5% 15.6% 17.6%
allenai/tulu-2-dpo-70b 15.4% 21.2% 23.0% 25.7%

Evaluation results on the MT-Bench benchmark (you can find the evaluation outputs on the official GitHub repo ):

Original + ExPO
HuggingFaceH4/zephyr-7b-alpha 6.85 6.87
HuggingFaceH4/zephyr-7b-beta 7.02 7.06
berkeley-nest/Starling-LM-7B-alpha 7.82 7.91
Nexusflow/Starling-LM-7B-beta 8.10 8.18
snorkelai/Snorkel-Mistral-PairRM 7.63 7.69
RLHFlow/LLaMA3-iterative-DPO-final 8.08 8.45
internlm/internlm2-chat-1.8b 5.17 5.26
internlm/internlm2-chat-7b 7.72 7.80
internlm/internlm2-chat-20b 8.13 8.26
allenai/tulu-2-dpo-7b 6.35 6.38
allenai/tulu-2-dpo-13b 7.00 7.26
allenai/tulu-2-dpo-70b 7.79 8.03

Runs of QuantFactory Llama-3-Instruct-8B-SimPO-ExPO-GGUF on huggingface.co

888
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs

More Information About Llama-3-Instruct-8B-SimPO-ExPO-GGUF huggingface.co Model

More Llama-3-Instruct-8B-SimPO-ExPO-GGUF license Visit here:

https://choosealicense.com/licenses/llama3

Llama-3-Instruct-8B-SimPO-ExPO-GGUF huggingface.co

Llama-3-Instruct-8B-SimPO-ExPO-GGUF huggingface.co is an AI model on huggingface.co that provides Llama-3-Instruct-8B-SimPO-ExPO-GGUF's model effect (), which can be used instantly with this QuantFactory Llama-3-Instruct-8B-SimPO-ExPO-GGUF model. huggingface.co supports a free trial of the Llama-3-Instruct-8B-SimPO-ExPO-GGUF model, and also provides paid use of the Llama-3-Instruct-8B-SimPO-ExPO-GGUF. Support call Llama-3-Instruct-8B-SimPO-ExPO-GGUF model through api, including Node.js, Python, http.

Llama-3-Instruct-8B-SimPO-ExPO-GGUF huggingface.co Url

https://huggingface.co/QuantFactory/Llama-3-Instruct-8B-SimPO-ExPO-GGUF

QuantFactory Llama-3-Instruct-8B-SimPO-ExPO-GGUF online free

Llama-3-Instruct-8B-SimPO-ExPO-GGUF huggingface.co is an online trial and call api platform, which integrates Llama-3-Instruct-8B-SimPO-ExPO-GGUF's modeling effects, including api services, and provides a free online trial of Llama-3-Instruct-8B-SimPO-ExPO-GGUF, you can try Llama-3-Instruct-8B-SimPO-ExPO-GGUF online for free by clicking the link below.

QuantFactory Llama-3-Instruct-8B-SimPO-ExPO-GGUF online free url in huggingface.co:

https://huggingface.co/QuantFactory/Llama-3-Instruct-8B-SimPO-ExPO-GGUF

Llama-3-Instruct-8B-SimPO-ExPO-GGUF install

Llama-3-Instruct-8B-SimPO-ExPO-GGUF is an open source model from GitHub that offers a free installation service, and any user can find Llama-3-Instruct-8B-SimPO-ExPO-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of Llama-3-Instruct-8B-SimPO-ExPO-GGUF install, users can directly use Llama-3-Instruct-8B-SimPO-ExPO-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Llama-3-Instruct-8B-SimPO-ExPO-GGUF install url in huggingface.co:

https://huggingface.co/QuantFactory/Llama-3-Instruct-8B-SimPO-ExPO-GGUF

Url of Llama-3-Instruct-8B-SimPO-ExPO-GGUF

Llama-3-Instruct-8B-SimPO-ExPO-GGUF huggingface.co Url

Provider of Llama-3-Instruct-8B-SimPO-ExPO-GGUF huggingface.co

QuantFactory
ORGANIZATIONS

Other API from QuantFactory