Total runs:
197
Run Growth:
100
Growth Rate:
50.76%
Sponsored by
ThumbnailCreator.com
Statuo / NemoMix-Unleashed-EXL2-8bpw
Model's Last Updated: August 23 2024
text-generation
Introduction of NemoMix-Unleashed-EXL2-8bpw
Model Details of NemoMix-Unleashed-EXL2-8bpw
Marinara said that they did a lot of testing on this one so I'm feeling pretty confident about quanting it out here. I know on their reddit post they said to use GGUF files but I don't really like using them. They seem to come with more issues (repetition especially) and longer load times, so I prefer my EXL2. But, eh, to each their own or something. The day I have to switch to GGUF will be the day I break down in tears.
This is the EXL2 8bpw verison of this model. You can find the original model here.
You can find the 6bpw version here.
You can find the 4bpw version here.
Information
Details
Okay, I tried really hard to improve my ChatML merges, but that has gone terribly wrong. Everyone is adding special tokens with different IDs so can't even make a proper union tokenizer for them, damn. Not to mention, I made some... interesting discoveres in regards to some models' context lenghts. You can watch the breakdown of how it went down here:
This one feels a bit different to my previous attempts and seems less prone to repetition, especially on higher contexts, which is great for me! I'll probably improve on it even further, but for now, it feels rather nice. Great for RP and storytelling. All credits and thanks go to the amazing MistralAI, Intervitens, Sao10K and Nbeerbower for their amazing models! Plus, special shoutouts to Parasitic Rogue for ideas and Prodeus Unity for cool exl2 quants of my previous merges. Have a good one, everyone.
Instruct
Sigh, Mistral Instruct, I'm afraid.
<s>[INST] {system} [/INST]{response}</s>[INST] {user's message} [/INST]{response}</s>
Parameters
I recommend running Temperature 1.0-1.25 with 0.1 Top A or 0.01-0.1 Min P, and with 0.8/1.75/2/0 DRY. Also works with lower Temperatures below 1.0. Nothing more needed.
Settings
You can use my exact settings from here (use the ones from the Mistral Base/Customized folder, I also recommend checking the Mistral Improved folder): https://huggingface.co/MarinaraSpaghetti/SillyTavern-Settings/tree/main .
GGUF
https://huggingface.co/bartowski/NemoMix-Unleashed-12B-GGUF
NemoMix-Unleashed-12B
This is a merge of pre-trained language models created using mergekit .
Merge Details
Merge Method
This model was merged using the della_linear merge method using E:\mergekit\mistralaiMistral-Nemo-Base-2407 as a base.
Models Merged
The following models were included in the merge:
- E:\mergekit\intervitens_mini-magnum-12b-v1.1
- E:\mergekit\nbeerbower_mistral-nemo-bophades-12B
- E:\mergekit\Sao10K_MN-12B-Lyra-v1
- E:\mergekit\nbeerbower_mistral-nemo-gutenberg-12B
- E:\mergekit\mistralaiMistral-Nemo-Instruct-2407
Configuration
The following YAML configuration was used to produce this model:
models:
- model: E:\mergekit\mistralaiMistral-Nemo-Instruct-2407
parameters:
weight: 0.1
density: 0.4
- model: E:\mergekit\nbeerbower_mistral-nemo-bophades-12B
parameters:
weight: 0.12
density: 0.5
- model: E:\mergekit\nbeerbower_mistral-nemo-gutenberg-12B
parameters:
weight: 0.2
density: 0.6
- model: E:\mergekit\Sao10K_MN-12B-Lyra-v1
parameters:
weight: 0.25
density: 0.7
- model: E:\mergekit\intervitens_mini-magnum-12b-v1.1
parameters:
weight: 0.33
density: 0.8
merge_method: della_linear
base_model: E:\mergekit\mistralaiMistral-Nemo-Base-2407
parameters:
epsilon: 0.05
lambda: 1
dtype: bfloat16
tokenizer_source: base
Ko-fi
Enjoying what I do? Consider donating here, thank you!
Runs of Statuo NemoMix-Unleashed-EXL2-8bpw on huggingface.co
32
Total runs
0
24-hour runs
2
3-day runs
5
7-day runs
5
30-day runs
More Information About NemoMix-Unleashed-EXL2-8bpw huggingface.co Model
Url of NemoMix-Unleashed-EXL2-8bpw
NemoMix-Unleashed-EXL2-8bpw huggingface.co Url
Provider of NemoMix-Unleashed-EXL2-8bpw huggingface.co
Other API from Statuo
Updated:December 16 2024
Total runs:
33
Run Growth:
-154
Growth Rate:
-466.67%
Total runs:
22
Run Growth:
10
Growth Rate:
45.45%
Total runs:
19
Run Growth:
7
Growth Rate:
36.84%
Total runs:
17
Run Growth:
6
Growth Rate:
35.29%
Total runs:
17
Run Growth:
7
Growth Rate:
41.18%
Total runs:
17
Run Growth:
4
Growth Rate:
23.53%
Total runs:
16
Run Growth:
6
Growth Rate:
37.50%
Total runs:
15
Run Growth:
4
Growth Rate:
26.67%
Total runs:
15
Run Growth:
0
Growth Rate:
0.00%
Total runs:
15
Run Growth:
2
Growth Rate:
13.33%
Total runs:
14
Run Growth:
5
Growth Rate:
35.71%
Total runs:
14
Run Growth:
1
Growth Rate:
7.14%
Total runs:
14
Run Growth:
1
Growth Rate:
7.14%
Total runs:
13
Run Growth:
3
Growth Rate:
23.08%
Total runs:
12
Run Growth:
0
Growth Rate:
0.00%
Total runs:
12
Run Growth:
8
Growth Rate:
66.67%
Total runs:
11
Run Growth:
5
Growth Rate:
45.45%
Total runs:
11
Run Growth:
6
Growth Rate:
54.55%
Total runs:
11
Run Growth:
2
Growth Rate:
18.18%
Total runs:
11
Run Growth:
2
Growth Rate:
18.18%
Total runs:
11
Run Growth:
-1
Growth Rate:
-9.09%
Total runs:
11
Run Growth:
5
Growth Rate:
45.45%
Total runs:
11
Run Growth:
2
Growth Rate:
18.18%
Total runs:
11
Run Growth:
2
Growth Rate:
16.67%
Total runs:
11
Run Growth:
3
Growth Rate:
27.27%
Total runs:
11
Run Growth:
3
Growth Rate:
27.27%
Total runs:
11
Run Growth:
2
Growth Rate:
16.67%
Total runs:
10
Run Growth:
6
Growth Rate:
60.00%
Total runs:
10
Run Growth:
5
Growth Rate:
50.00%
Total runs:
10
Run Growth:
6
Growth Rate:
60.00%
Total runs:
9
Run Growth:
4
Growth Rate:
44.44%
Total runs:
9
Run Growth:
5
Growth Rate:
55.56%
Total runs:
8
Run Growth:
1
Growth Rate:
12.50%
Total runs:
8
Run Growth:
3
Growth Rate:
37.50%
Total runs:
8
Run Growth:
3
Growth Rate:
37.50%
Total runs:
8
Run Growth:
8
Growth Rate:
88.89%
Total runs:
7
Run Growth:
3
Growth Rate:
42.86%
Total runs:
7
Run Growth:
2
Growth Rate:
28.57%
Total runs:
7
Run Growth:
2
Growth Rate:
28.57%
Total runs:
7
Run Growth:
2
Growth Rate:
28.57%
Total runs:
7
Run Growth:
5
Growth Rate:
71.43%
Total runs:
6
Run Growth:
3
Growth Rate:
50.00%
Total runs:
6
Run Growth:
1
Growth Rate:
16.67%
Total runs:
6
Run Growth:
2
Growth Rate:
33.33%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
1
Growth Rate:
20.00%
Total runs:
5
Run Growth:
4
Growth Rate:
66.67%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
1
Growth Rate:
20.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
1
Growth Rate:
25.00%
Total runs:
4
Run Growth:
-1
Growth Rate:
-25.00%
Total runs:
4
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
-2
Growth Rate:
-50.00%
Total runs:
4
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
-3
Growth Rate:
-75.00%
Total runs:
4
Run Growth:
3
Growth Rate:
75.00%
Total runs:
4
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
4
Growth Rate:
100.00%
Total runs:
3
Run Growth:
1
Growth Rate:
33.33%
Total runs:
3
Run Growth:
2
Growth Rate:
50.00%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%
Total runs:
3
Run Growth:
3
Growth Rate:
100.00%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
-1
Growth Rate:
-33.33%
Total runs:
3
Run Growth:
3
Growth Rate:
100.00%
Total runs:
3
Run Growth:
-2
Growth Rate:
-66.67%
Total runs:
3
Run Growth:
-1
Growth Rate:
-33.33%
Total runs:
3
Run Growth:
-1
Growth Rate:
-33.33%
Total runs:
3
Run Growth:
3
Growth Rate:
100.00%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%
Total runs:
2
Run Growth:
2
Growth Rate:
100.00%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
-5
Growth Rate:
-250.00%
Total runs:
2
Run Growth:
-2
Growth Rate:
-100.00%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
-2
Growth Rate:
-100.00%
Total runs:
2
Run Growth:
-2
Growth Rate:
-100.00%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
1
Growth Rate:
50.00%
Total runs:
2
Run Growth:
-4
Growth Rate:
-200.00%
Total runs:
2
Run Growth:
-2
Growth Rate:
-100.00%
Total runs:
1
Run Growth:
1
Growth Rate:
100.00%
Total runs:
1
Run Growth:
-2
Growth Rate:
-200.00%