Total runs:
12.6K
Run Growth:
759
Growth Rate:
6.05%
Sponsored by
iMean AI Trip Planner
leafspark / Mistral-Large-218B-Instruct
Model's Last Updated: August 06 2024
text-generation
Introduction of Mistral-Large-218B-Instruct
Model Details of Mistral-Large-218B-Instruct
Mistral-Large-218B-Instruct
Mistral-Large-218B-Instruct is a dense Large Language Model (LLM) with 218 billion parameters. Self-merged from the original Mistral Large 2.
Key features
- 218 billion parameters
- Multi-lingual support for dozens of languages
- Trained on 80+ coding languages
- 128k context window
- Mistral Research License: Allows usage and modification for research and non-commercial purposes
Hardware Requirements
Given the size of this model (218B parameters), it requires substantial computational resources for inference:
- Recommended: 8xH100 (640GB)
- Alternatively: Distributed inference setup across multiple machines
Limitations
- No built-in moderation mechanisms
- Computationally expensive inference
- May exhibit biases present in training data
- Outputs should be critically evaluated for sensitive applications
Notes
This was just a fun testing model, merged with the
merge.py
script in the base of the repo.
Quants
GGUF: mradermacher/Mistral-Large-218B-Instruct-GGUF
imatrix GGUF: mradermacher/Mistral-Large-218B-Instruct-i1-GGUF
Compatible
mergekit
config:
slices:
- sources:
- layer_range: [0, 20]
model: mistralai/Mistral-Large-Instruct-2407
- sources:
- layer_range: [10, 30]
model: mistralai/Mistral-Large-Instruct-2407
- sources:
- layer_range: [20, 40]
model: mistralai/Mistral-Large-Instruct-2407
- sources:
- layer_range: [30, 50]
model: mistralai/Mistral-Large-Instruct-2407
- sources:
- layer_range: [40, 60]
model: mistralai/Mistral-Large-Instruct-2407
- sources:
- layer_range: [50, 70]
model: mistralai/Mistral-Large-Instruct-2407
- sources:
- layer_range: [60, 80]
model: mistralai/Mistral-Large-Instruct-2407
- sources:
- layer_range: [70, 87]
model: mistralai/Mistral-Large-Instruct-2407
merge_method: passthrough
dtype: bfloat16
Runs of leafspark Mistral-Large-218B-Instruct on huggingface.co
15
Total runs
0
24-hour runs
0
3-day runs
-4
7-day runs
-18
30-day runs
More Information About Mistral-Large-218B-Instruct huggingface.co Model
Url of Mistral-Large-218B-Instruct
Mistral-Large-218B-Instruct huggingface.co Url
Provider of Mistral-Large-218B-Instruct huggingface.co
Other API from leafspark
Updated:January 09 2025
Total runs:
1.6K
Run Growth:
405
Growth Rate:
24.85%
Total runs:
1.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
612
Run Growth:
0
Growth Rate:
0.00%
Total runs:
422
Run Growth:
149
Growth Rate:
35.31%
Total runs:
352
Run Growth:
-667
Growth Rate:
-189.49%
Total runs:
335
Run Growth:
0
Growth Rate:
0.00%
Total runs:
142
Run Growth:
92
Growth Rate:
64.79%
Total runs:
120
Run Growth:
53
Growth Rate:
44.17%
Total runs:
72
Run Growth:
-137
Growth Rate:
-190.28%
Total runs:
61
Run Growth:
20
Growth Rate:
32.79%
Total runs:
46
Run Growth:
-63
Growth Rate:
-136.96%
Total runs:
46
Run Growth:
0
Growth Rate:
0.00%
Total runs:
44
Run Growth:
-5
Growth Rate:
-11.36%
Total runs:
43
Run Growth:
-39
Growth Rate:
-90.70%
Total runs:
37
Run Growth:
-21
Growth Rate:
-56.76%
Total runs:
34
Run Growth:
0
Growth Rate:
0.00%
Total runs:
31
Run Growth:
14
Growth Rate:
45.16%
Total runs:
31
Run Growth:
-29
Growth Rate:
-93.55%
Total runs:
30
Run Growth:
13
Growth Rate:
43.33%
Total runs:
28
Run Growth:
17
Growth Rate:
60.71%
Total runs:
22
Run Growth:
10
Growth Rate:
45.45%
Total runs:
19
Run Growth:
4
Growth Rate:
21.05%
Total runs:
16
Run Growth:
8
Growth Rate:
50.00%
Total runs:
14
Run Growth:
10
Growth Rate:
71.43%
Total runs:
11
Run Growth:
7
Growth Rate:
63.64%
Total runs:
10
Run Growth:
8
Growth Rate:
80.00%
Total runs:
10
Run Growth:
2
Growth Rate:
20.00%
Total runs:
10
Run Growth:
2
Growth Rate:
20.00%
Total runs:
9
Run Growth:
8
Growth Rate:
88.89%
Total runs:
9
Run Growth:
-2
Growth Rate:
-22.22%
Total runs:
8
Run Growth:
3
Growth Rate:
37.50%
Total runs:
7
Run Growth:
6
Growth Rate:
85.71%
Total runs:
7
Run Growth:
-3
Growth Rate:
-42.86%
Total runs:
7
Run Growth:
5
Growth Rate:
71.43%
Total runs:
6
Run Growth:
6
Growth Rate:
100.00%
Total runs:
6
Run Growth:
3
Growth Rate:
50.00%
Total runs:
6
Run Growth:
5
Growth Rate:
83.33%
Total runs:
6
Run Growth:
-7
Growth Rate:
-116.67%
Total runs:
6
Run Growth:
4
Growth Rate:
66.67%
Total runs:
5
Run Growth:
3
Growth Rate:
60.00%
Total runs:
5
Run Growth:
4
Growth Rate:
80.00%
Total runs:
5
Run Growth:
5
Growth Rate:
100.00%
Total runs:
5
Run Growth:
2
Growth Rate:
40.00%
Total runs:
5
Run Growth:
-1
Growth Rate:
-20.00%
Total runs:
4
Run Growth:
2
Growth Rate:
50.00%
Total runs:
4
Run Growth:
3
Growth Rate:
75.00%
Total runs:
3
Run Growth:
-7
Growth Rate:
-233.33%
Total runs:
3
Run Growth:
3
Growth Rate:
100.00%
Total runs:
2
Run Growth:
2
Growth Rate:
100.00%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1
Run Growth:
-5
Growth Rate:
-500.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%