EmbeddedLLM / Mistral-7B-Merge-02-v0

huggingface.co
Total runs: 54
24-hour runs: 0
7-day runs: 3
30-day runs: -7
Model's Last Updated: January 21 2024
text-generation

Introduction of Mistral-7B-Merge-02-v0

Model Details of Mistral-7B-Merge-02-v0

Model Description

This is an experiment to compare merging 2 models using DARE TIES versus SLERP 🦙

We are mainly interested to compare against Weyaxi/OpenHermes-2.5-neural-chat-v3-3-Slerp

The 2 models involved in the merge as follows:

  1. teknium/OpenHermes-2.5-Mistral-7B
  2. Intel/neural-chat-7b-v3-3

The yaml config file for the merge is:

models:
  - model: mistralai/Mistral-7B-v0.1
    # no parameters necessary for base model
  - model: teknium/OpenHermes-2.5-Mistral-7B
    parameters:
      weight: 0.5
      density: 0.5
  - model: Intel/neural-chat-7b-v3-3
    parameters:
      weight: 0.5
      density: 0.5
merge_method: dare_ties
base_model: mistralai/Mistral-7B-v0.1
parameters:
  int8_mask: true
dtype: bfloat16

Open LLM Leaderboard

Note that with more tuning DARE TIES might achieve better results.

DARE TIES SLERP
Average 70.69 71.38
ARC 67.49 68.09
HellaSwag 85.78 86.2
MMLU 64.1 64.26
TruthfulQA 60.52 62.78
Winogrande 79.01 79.16
GSM8K 67.25 67.78

Runs of EmbeddedLLM Mistral-7B-Merge-02-v0 on huggingface.co

54
Total runs
0
24-hour runs
1
3-day runs
3
7-day runs
-7
30-day runs

More Information About Mistral-7B-Merge-02-v0 huggingface.co Model

More Mistral-7B-Merge-02-v0 license Visit here:

https://choosealicense.com/licenses/apache-2.0

Mistral-7B-Merge-02-v0 huggingface.co

Mistral-7B-Merge-02-v0 huggingface.co is an AI model on huggingface.co that provides Mistral-7B-Merge-02-v0's model effect (), which can be used instantly with this EmbeddedLLM Mistral-7B-Merge-02-v0 model. huggingface.co supports a free trial of the Mistral-7B-Merge-02-v0 model, and also provides paid use of the Mistral-7B-Merge-02-v0. Support call Mistral-7B-Merge-02-v0 model through api, including Node.js, Python, http.

Mistral-7B-Merge-02-v0 huggingface.co Url

https://huggingface.co/EmbeddedLLM/Mistral-7B-Merge-02-v0

EmbeddedLLM Mistral-7B-Merge-02-v0 online free

Mistral-7B-Merge-02-v0 huggingface.co is an online trial and call api platform, which integrates Mistral-7B-Merge-02-v0's modeling effects, including api services, and provides a free online trial of Mistral-7B-Merge-02-v0, you can try Mistral-7B-Merge-02-v0 online for free by clicking the link below.

EmbeddedLLM Mistral-7B-Merge-02-v0 online free url in huggingface.co:

https://huggingface.co/EmbeddedLLM/Mistral-7B-Merge-02-v0

Mistral-7B-Merge-02-v0 install

Mistral-7B-Merge-02-v0 is an open source model from GitHub that offers a free installation service, and any user can find Mistral-7B-Merge-02-v0 on GitHub to install. At the same time, huggingface.co provides the effect of Mistral-7B-Merge-02-v0 install, users can directly use Mistral-7B-Merge-02-v0 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Mistral-7B-Merge-02-v0 install url in huggingface.co:

https://huggingface.co/EmbeddedLLM/Mistral-7B-Merge-02-v0

Url of Mistral-7B-Merge-02-v0

Mistral-7B-Merge-02-v0 huggingface.co Url

Provider of Mistral-7B-Merge-02-v0 huggingface.co

EmbeddedLLM
ORGANIZATIONS

Other API from EmbeddedLLM