Total runs:
8.1K
Run Growth:
70
Growth Rate:
0.87%
Sponsored by
Vmake Labs Video Enhancer
maywell / Synatra-Mixtral-8x7B-exl2
Model's Last Updated: February 02 2024
Introduction of Synatra-Mixtral-8x7B-exl2
Model Details of Synatra-Mixtral-8x7B-exl2
Synatra-Mixtral-8x7B (Original Weight)
Synatra-Mixtral-8x7B is a fine-tuned version of the Mixtral-8x7B-Instruct-v0.1 model using Korean datasets.
This model features overwhelmingly superior comprehension and inference capabilities and is licensed under apache-2.0.
EXL2 Info
8.0bpw , 6.0bpw , 4.0bpw , 3.5bpw , 3.0bpw , 2.6bpw , 2.3bpw
License
OPEN , Apache-2.0.
Model Details
Base Model
mistralai/Mixtral-8x7B-Instruct-v0.1
Trained On
A100 80GB * 6
Instruction format
It follows Alpaca format.
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{input}
### Response:
{output}
Model Benchmark
TBD
Implementation Code
from transformers import AutoModelForCausalLM, AutoTokenizer
device = "cuda" # the device to load the model onto
model = AutoModelForCausalLM.from_pretrained("maywell/Synatra-Mixtral-8x7B")
tokenizer = AutoTokenizer.from_pretrained("maywell/Synatra-Mixtral-8x7B")
messages = [
{"role": "user", "content": "아인슈타인의 상대성이론에 대해서 자세히 설명해줘."},
]
encodeds = tokenizer.apply_chat_template(messages, return_tensors="pt")
model_inputs = encodeds.to(device)
model.to(device)
generated_ids = model.generate(model_inputs, max_new_tokens=1000, do_sample=True)
decoded = tokenizer.batch_decode(generated_ids)
print(decoded[0])
Author's Message
This model's training got sponsered by no one but support from people around Earth.
Contact Me on Discord - is.maywell
Follow me on twitter: https://twitter.com/stablefluffy
Runs of maywell Synatra-Mixtral-8x7B-exl2 on huggingface.co
18
Total runs
0
24-hour runs
1
3-day runs
1
7-day runs
2
30-day runs
More Information About Synatra-Mixtral-8x7B-exl2 huggingface.co Model
Url of Synatra-Mixtral-8x7B-exl2
Synatra-Mixtral-8x7B-exl2 huggingface.co Url
Provider of Synatra-Mixtral-8x7B-exl2 huggingface.co
Other API from maywell
Updated:November 21 2023
Total runs:
905
Run Growth:
-25
Growth Rate:
-2.76%
Total runs:
897
Run Growth:
-45
Growth Rate:
-5.02%
Total runs:
893
Run Growth:
-48
Growth Rate:
-5.38%
Total runs:
832
Run Growth:
-34
Growth Rate:
-4.09%
Total runs:
826
Run Growth:
-28
Growth Rate:
-3.39%
Total runs:
825
Run Growth:
-42
Growth Rate:
-5.09%
Total runs:
430
Run Growth:
-542
Growth Rate:
-126.34%
Total runs:
185
Run Growth:
0
Growth Rate:
0.00%
Total runs:
183
Run Growth:
115
Growth Rate:
63.19%
Total runs:
133
Run Growth:
17
Growth Rate:
12.78%
Total runs:
129
Run Growth:
29
Growth Rate:
22.14%
Total runs:
120
Run Growth:
-352
Growth Rate:
-293.33%
Total runs:
100
Run Growth:
-306
Growth Rate:
-306.00%
Total runs:
98
Run Growth:
-309
Growth Rate:
-315.31%
Total runs:
86
Run Growth:
53
Growth Rate:
60.23%
Total runs:
78
Run Growth:
62
Growth Rate:
79.49%
Total runs:
78
Run Growth:
-4
Growth Rate:
-5.13%
Total runs:
71
Run Growth:
-12
Growth Rate:
-16.90%
Total runs:
61
Run Growth:
9
Growth Rate:
14.75%
Total runs:
55
Run Growth:
-7
Growth Rate:
-12.73%
Total runs:
37
Run Growth:
-5
Growth Rate:
-13.51%
Total runs:
25
Run Growth:
14
Growth Rate:
60.87%
Total runs:
24
Run Growth:
-2
Growth Rate:
-8.33%
Total runs:
24
Run Growth:
7
Growth Rate:
36.84%
Total runs:
16
Run Growth:
1
Growth Rate:
6.25%
Total runs:
16
Run Growth:
10
Growth Rate:
62.50%
Total runs:
14
Run Growth:
9
Growth Rate:
64.29%
Total runs:
14
Run Growth:
2
Growth Rate:
14.29%
Total runs:
13
Run Growth:
11
Growth Rate:
84.62%
Total runs:
12
Run Growth:
-30
Growth Rate:
-250.00%
Total runs:
12
Run Growth:
8
Growth Rate:
66.67%
Total runs:
11
Run Growth:
7
Growth Rate:
63.64%
Total runs:
11
Run Growth:
-17
Growth Rate:
-154.55%
Total runs:
11
Run Growth:
7
Growth Rate:
63.64%
Total runs:
10
Run Growth:
3
Growth Rate:
30.00%
Total runs:
10
Run Growth:
6
Growth Rate:
60.00%
Total runs:
10
Run Growth:
9
Growth Rate:
90.00%
Total runs:
9
Run Growth:
-5
Growth Rate:
-55.56%
Total runs:
9
Run Growth:
5
Growth Rate:
55.56%
Total runs:
9
Run Growth:
-1
Growth Rate:
-11.11%
Total runs:
7
Run Growth:
2
Growth Rate:
28.57%
Total runs:
6
Run Growth:
2
Growth Rate:
33.33%
Total runs:
6
Run Growth:
-3
Growth Rate:
-50.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%