G-reen / EXPERIMENT-SFT-m7b2-3-merged

huggingface.co
Total runs: 5
24-hour runs: 0
7-day runs: -4
30-day runs: -12
Model's Last Updated: April 16 2024
text-generation

Introduction of EXPERIMENT-SFT-m7b2-3-merged

Model Details of EXPERIMENT-SFT-m7b2-3-merged

This model was trained as part of a series of experiments testing the performance of pure DPO vs SFT vs ORPO, all supported by Unsloth/Huggingface TRL.

Benchmarks

Average 59.55

ARC 59.56

HellaSwag 82.39

MMLU 62.3

TruthfulQA 40.04

Winogrande 78.45

GSM8K 34.57

Training Details

Duration: ~6-8 hours on one Kaggle T4 with Unsloth

Model: https://huggingface.co/unsloth/mistral-7b-v0.2-bnb-4bit

Dataset: https://huggingface.co/datasets/argilla/dpo-mix-7k

Rank: 8

Alpha: 16

Learning rate: 5e-6

Batch size: 8

Epochs: 1

Learning rate scheduler: Linear

Prompt Format: ChatML

<|im_start|>system
You are a helpful assistant.<|im_end|>
<|im_start|>user
Why is the sky blue?<|im_end|>
<|im_start|>assistant

WanDB Reports

image/png

Runs of G-reen EXPERIMENT-SFT-m7b2-3-merged on huggingface.co

5
Total runs
0
24-hour runs
0
3-day runs
-4
7-day runs
-12
30-day runs

More Information About EXPERIMENT-SFT-m7b2-3-merged huggingface.co Model

More EXPERIMENT-SFT-m7b2-3-merged license Visit here:

https://choosealicense.com/licenses/apache-2.0

EXPERIMENT-SFT-m7b2-3-merged huggingface.co

EXPERIMENT-SFT-m7b2-3-merged huggingface.co is an AI model on huggingface.co that provides EXPERIMENT-SFT-m7b2-3-merged's model effect (), which can be used instantly with this G-reen EXPERIMENT-SFT-m7b2-3-merged model. huggingface.co supports a free trial of the EXPERIMENT-SFT-m7b2-3-merged model, and also provides paid use of the EXPERIMENT-SFT-m7b2-3-merged. Support call EXPERIMENT-SFT-m7b2-3-merged model through api, including Node.js, Python, http.

EXPERIMENT-SFT-m7b2-3-merged huggingface.co Url

https://huggingface.co/G-reen/EXPERIMENT-SFT-m7b2-3-merged

G-reen EXPERIMENT-SFT-m7b2-3-merged online free

EXPERIMENT-SFT-m7b2-3-merged huggingface.co is an online trial and call api platform, which integrates EXPERIMENT-SFT-m7b2-3-merged's modeling effects, including api services, and provides a free online trial of EXPERIMENT-SFT-m7b2-3-merged, you can try EXPERIMENT-SFT-m7b2-3-merged online for free by clicking the link below.

G-reen EXPERIMENT-SFT-m7b2-3-merged online free url in huggingface.co:

https://huggingface.co/G-reen/EXPERIMENT-SFT-m7b2-3-merged

EXPERIMENT-SFT-m7b2-3-merged install

EXPERIMENT-SFT-m7b2-3-merged is an open source model from GitHub that offers a free installation service, and any user can find EXPERIMENT-SFT-m7b2-3-merged on GitHub to install. At the same time, huggingface.co provides the effect of EXPERIMENT-SFT-m7b2-3-merged install, users can directly use EXPERIMENT-SFT-m7b2-3-merged installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

EXPERIMENT-SFT-m7b2-3-merged install url in huggingface.co:

https://huggingface.co/G-reen/EXPERIMENT-SFT-m7b2-3-merged

Url of EXPERIMENT-SFT-m7b2-3-merged

EXPERIMENT-SFT-m7b2-3-merged huggingface.co Url

Provider of EXPERIMENT-SFT-m7b2-3-merged huggingface.co

G-reen
ORGANIZATIONS

Other API from G-reen

huggingface.co

Total runs: 15
Run Growth: 0
Growth Rate: 0.00%
Updated:September 04 2024
huggingface.co

Total runs: 8
Run Growth: 0
Growth Rate: 0.00%
Updated:June 02 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:August 26 2024