Total runs:
8.8K
Run Growth:
85
Growth Rate:
0.97%
Sponsored by
AdsCreator.com
cloudyu / Mixtral_7Bx4_MOE_24B
Model's Last Updated: August 23 2024
text-generation
Introduction of Mixtral_7Bx4_MOE_24B
Model Details of Mixtral_7Bx4_MOE_24B
I don't know why so many downloads about this model. Please share your cases, thanks.
Now this model is improved by DPO to cloudyu/Pluto_24B_DPO_200
-
Metrics improved by DPO
Mixtral MOE 4x7B
MOE the following models by mergekit:
- Q-bert/MetaMath-Cybertron-Starling
- mistralai/Mistral-7B-Instruct-v0.2
- teknium/Mistral-Trismegistus-7B
- meta-math/MetaMath-Mistral-7B
- openchat/openchat-3.5-1210
Metrics
- Average : 68.85
- ARC:65.36
- HellaSwag:85.23
- more details: https://huggingface.co/datasets/open-llm-leaderboard/results/blob/main/cloudyu/Mixtral_7Bx4_MOE_24B/results_2023-12-23T18-05-51.243288.json
gpu code example
import torch
from transformers import AutoTokenizer, AutoModelForCausalLM
import math
## v2 models
model_path = "cloudyu/Mixtral_7Bx4_MOE_24B"
tokenizer = AutoTokenizer.from_pretrained(model_path, use_default_system_prompt=False)
model = AutoModelForCausalLM.from_pretrained(
model_path, torch_dtype=torch.float32, device_map='auto',local_files_only=False, load_in_4bit=True
)
print(model)
prompt = input("please input prompt:")
while len(prompt) > 0:
input_ids = tokenizer(prompt, return_tensors="pt").input_ids.to("cuda")
generation_output = model.generate(
input_ids=input_ids, max_new_tokens=500,repetition_penalty=1.2
)
print(tokenizer.decode(generation_output[0]))
prompt = input("please input prompt:")
CPU example
import torch
from transformers import AutoTokenizer, AutoModelForCausalLM
import math
## v2 models
model_path = "cloudyu/Mixtral_7Bx4_MOE_24B"
tokenizer = AutoTokenizer.from_pretrained(model_path, use_default_system_prompt=False)
model = AutoModelForCausalLM.from_pretrained(
model_path, torch_dtype=torch.float32, device_map='cpu',local_files_only=False
)
print(model)
prompt = input("please input prompt:")
while len(prompt) > 0:
input_ids = tokenizer(prompt, return_tensors="pt").input_ids
generation_output = model.generate(
input_ids=input_ids, max_new_tokens=500,repetition_penalty=1.2
)
print(tokenizer.decode(generation_output[0]))
prompt = input("please input prompt:")
Runs of cloudyu Mixtral_7Bx4_MOE_24B on huggingface.co
154
Total runs
0
24-hour runs
11
3-day runs
24
7-day runs
77
30-day runs
More Information About Mixtral_7Bx4_MOE_24B huggingface.co Model
Url of Mixtral_7Bx4_MOE_24B
Mixtral_7Bx4_MOE_24B huggingface.co Url
Provider of Mixtral_7Bx4_MOE_24B huggingface.co
Other API from cloudyu
Updated:January 06 2026
Total runs:
8.7K
Run Growth:
198
Growth Rate:
2.27%
Total runs:
8.7K
Run Growth:
185
Growth Rate:
2.13%
Total runs:
2.1K
Run Growth:
-310
Growth Rate:
-14.80%
Total runs:
1.3K
Run Growth:
345
Growth Rate:
26.26%
Total runs:
764
Run Growth:
-78
Growth Rate:
-10.21%
Total runs:
753
Run Growth:
553
Growth Rate:
73.44%
Total runs:
643
Run Growth:
309
Growth Rate:
48.06%
Total runs:
475
Run Growth:
77
Growth Rate:
16.21%
Total runs:
364
Run Growth:
269
Growth Rate:
73.90%
Total runs:
123
Run Growth:
82
Growth Rate:
66.67%
Total runs:
117
Run Growth:
93
Growth Rate:
79.49%
Total runs:
114
Run Growth:
7
Growth Rate:
6.14%
Total runs:
98
Run Growth:
34
Growth Rate:
34.69%
Total runs:
89
Run Growth:
11
Growth Rate:
12.36%
Total runs:
83
Run Growth:
17
Growth Rate:
20.48%
Total runs:
83
Run Growth:
-6
Growth Rate:
-7.23%
Total runs:
83
Run Growth:
-38
Growth Rate:
-45.78%
Total runs:
79
Run Growth:
13
Growth Rate:
16.46%
Total runs:
78
Run Growth:
21
Growth Rate:
26.92%
Total runs:
77
Run Growth:
-4
Growth Rate:
-5.19%
Total runs:
76
Run Growth:
33
Growth Rate:
43.42%
Total runs:
74
Run Growth:
7
Growth Rate:
9.46%
Total runs:
73
Run Growth:
0
Growth Rate:
0.00%
Total runs:
73
Run Growth:
-27
Growth Rate:
-36.99%
Total runs:
71
Run Growth:
11
Growth Rate:
15.07%
Total runs:
68
Run Growth:
-39
Growth Rate:
-57.35%
Total runs:
68
Run Growth:
-14
Growth Rate:
-20.59%
Total runs:
65
Run Growth:
-39
Growth Rate:
-60.00%
Total runs:
62
Run Growth:
-1
Growth Rate:
-1.56%
Total runs:
53
Run Growth:
-28
Growth Rate:
-52.83%
Total runs:
38
Run Growth:
16
Growth Rate:
42.11%
Total runs:
32
Run Growth:
12
Growth Rate:
37.50%
Total runs:
30
Run Growth:
20
Growth Rate:
66.67%
Total runs:
29
Run Growth:
14
Growth Rate:
48.28%
Total runs:
28
Run Growth:
14
Growth Rate:
50.00%
Total runs:
27
Run Growth:
2
Growth Rate:
7.41%
Total runs:
25
Run Growth:
25
Growth Rate:
100.00%
Total runs:
25
Run Growth:
12
Growth Rate:
48.00%
Total runs:
23
Run Growth:
14
Growth Rate:
60.87%
Total runs:
22
Run Growth:
11
Growth Rate:
50.00%
Total runs:
22
Run Growth:
0
Growth Rate:
0.00%
Total runs:
21
Run Growth:
11
Growth Rate:
52.38%
Total runs:
17
Run Growth:
7
Growth Rate:
41.18%
Total runs:
6
Run Growth:
2
Growth Rate:
33.33%
Total runs:
5
Run Growth:
-1
Growth Rate:
-20.00%
Total runs:
3
Run Growth:
-3
Growth Rate:
-100.00%
Total runs:
2
Run Growth:
2
Growth Rate:
100.00%
Total runs:
1
Run Growth:
1
Growth Rate:
100.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%