Total runs:
197
Run Growth:
100
Growth Rate:
50.76%
Sponsored by
iMean AI Trip Planner
Statuo / Lyra-V4-EXL2-8bpw
Model's Last Updated: September 08 2024
Introduction of Lyra-V4-EXL2-8bpw
Model Details of Lyra-V4-EXL2-8bpw
Sao mentioned this model had some fixes, so make sure you read their notes at the bottom of the model card please. I ran some tests through it to be safe, it seemed to perform well at a 16k context limit, but can't confirm anything beyond that. Unlike Stardust it has some of the evil characters giving you second chances, so you might need to prompt that out.
You probably need to be using a Min P of - at most .1 - with Nemo models. This is of course assuming you aren't using any other sliders to modify token selection probability (e.g. Top K). Going farther than that and it seems like you start to get broken words.
Anyway, another Lyra model. Hype indeed. Sao delivers once again.
This is the 8bpw EXL2 quant of this model. You can find the original model here.
You can find the 6bpw version here
You can find the 4bpw version here
Mistral-NeMo-12B-Lyra-v4, a variation of Lyra-v4a1 , layered over Lyra-v3 , which was built on top of Lyra-v2a2 , which itself was built upon Lyra-v2a1 .
Model Versioning
[See Previous Models]
|
Lyra-v4a1
|
------------> Lyra-v4 [Seperate RL Step targeting Instruct and Coherency over Base Nemo instead of SFT First, Result is Merged with Lyra-v4a1, fixes most quant-based issues. Somehow.]
This uses ChatML, or any of its variants which were included in previous versions.
<|im_start|>system
This is the system prompt.<|im_end|>
<|im_start|>user
Instructions placed here.<|im_end|>
<|im_start|>assistant
The model's response will be here.<|im_end|>
--------------------------------------------------
[INST]system
This is another system prompt.[/INST]
[INST]user
Your instructions placed here.[/INST]
[INST]assistant
The model's response will be here.[/INST]
Recommended Samplers:
Temperature: 0.6 - 1 # Make sure min_p is set before Temperature in Sampler Orders
min_p: 0.1 - 0.2 # Crucial for NeMo
Recommended Stopping Strings:
<|im_end|>
</s>
[/INST]
Notes
- I think I fixed the extra token stuff some users seem to be facing, while retaining everything else? It's some error alright.
- If you're using XML tags, you may see weird malformed stopping strings. Just add them to your current list. and move on.
- Its pretty nice, imo. I've been messing around with it a lot.
- Make sure the ChatML template is correct, I think there's some issues with the one used in SillyTavern which might cause improper replies?
Runs of Statuo Lyra-V4-EXL2-8bpw on huggingface.co
1
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
1
30-day runs
More Information About Lyra-V4-EXL2-8bpw huggingface.co Model
Url of Lyra-V4-EXL2-8bpw
Lyra-V4-EXL2-8bpw huggingface.co Url
Provider of Lyra-V4-EXL2-8bpw huggingface.co
Other API from Statuo
Updated:December 16 2024
Total runs:
33
Run Growth:
-154
Growth Rate:
-466.67%
Total runs:
32
Run Growth:
5
Growth Rate:
15.63%
Total runs:
15
Run Growth:
9
Growth Rate:
60.00%
Total runs:
15
Run Growth:
0
Growth Rate:
0.00%
Total runs:
14
Run Growth:
6
Growth Rate:
42.86%
Total runs:
12
Run Growth:
6
Growth Rate:
50.00%
Total runs:
12
Run Growth:
7
Growth Rate:
58.33%
Total runs:
12
Run Growth:
7
Growth Rate:
58.33%
Total runs:
12
Run Growth:
7
Growth Rate:
58.33%
Total runs:
12
Run Growth:
0
Growth Rate:
0.00%
Total runs:
12
Run Growth:
8
Growth Rate:
61.54%
Total runs:
12
Run Growth:
7
Growth Rate:
58.33%
Total runs:
12
Run Growth:
6
Growth Rate:
50.00%
Total runs:
12
Run Growth:
5
Growth Rate:
41.67%
Total runs:
12
Run Growth:
6
Growth Rate:
50.00%
Total runs:
12
Run Growth:
6
Growth Rate:
50.00%
Total runs:
12
Run Growth:
8
Growth Rate:
61.54%
Total runs:
11
Run Growth:
-1
Growth Rate:
-9.09%
Total runs:
11
Run Growth:
2
Growth Rate:
18.18%
Total runs:
11
Run Growth:
2
Growth Rate:
18.18%
Total runs:
11
Run Growth:
6
Growth Rate:
50.00%
Total runs:
10
Run Growth:
5
Growth Rate:
50.00%
Total runs:
10
Run Growth:
2
Growth Rate:
20.00%
Total runs:
10
Run Growth:
4
Growth Rate:
40.00%
Total runs:
9
Run Growth:
2
Growth Rate:
22.22%
Total runs:
8
Run Growth:
1
Growth Rate:
12.50%
Total runs:
8
Run Growth:
1
Growth Rate:
12.50%
Total runs:
8
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8
Run Growth:
-11
Growth Rate:
-137.50%
Total runs:
8
Run Growth:
3
Growth Rate:
37.50%
Total runs:
8
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8
Run Growth:
-1
Growth Rate:
-12.50%
Total runs:
6
Run Growth:
0
Growth Rate:
0.00%
Total runs:
6
Run Growth:
2
Growth Rate:
33.33%
Total runs:
6
Run Growth:
0
Growth Rate:
0.00%
Total runs:
6
Run Growth:
3
Growth Rate:
50.00%
Total runs:
6
Run Growth:
3
Growth Rate:
50.00%
Total runs:
6
Run Growth:
-1
Growth Rate:
-16.67%
Total runs:
6
Run Growth:
1
Growth Rate:
16.67%
Total runs:
6
Run Growth:
4
Growth Rate:
66.67%
Total runs:
6
Run Growth:
4
Growth Rate:
66.67%
Total runs:
6
Run Growth:
0
Growth Rate:
0.00%
Total runs:
6
Run Growth:
2
Growth Rate:
33.33%
Total runs:
6
Run Growth:
3
Growth Rate:
50.00%
Total runs:
6
Run Growth:
4
Growth Rate:
66.67%
Total runs:
6
Run Growth:
3
Growth Rate:
50.00%
Total runs:
6
Run Growth:
-6
Growth Rate:
-100.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
-3
Growth Rate:
-50.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
3
Growth Rate:
60.00%
Total runs:
5
Run Growth:
2
Growth Rate:
40.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
2
Growth Rate:
40.00%
Total runs:
5
Run Growth:
2
Growth Rate:
40.00%
Total runs:
5
Run Growth:
3
Growth Rate:
60.00%
Total runs:
5
Run Growth:
2
Growth Rate:
40.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
3
Growth Rate:
60.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
-1
Growth Rate:
-25.00%
Total runs:
4
Run Growth:
-1
Growth Rate:
-25.00%
Total runs:
4
Run Growth:
1
Growth Rate:
25.00%
Total runs:
4
Run Growth:
-1
Growth Rate:
-25.00%
Total runs:
4
Run Growth:
-1
Growth Rate:
-25.00%
Total runs:
4
Run Growth:
-2
Growth Rate:
-50.00%
Total runs:
4
Run Growth:
1
Growth Rate:
25.00%
Total runs:
4
Run Growth:
3
Growth Rate:
75.00%
Total runs:
4
Run Growth:
-1
Growth Rate:
-25.00%
Total runs:
4
Run Growth:
4
Growth Rate:
100.00%
Total runs:
3
Run Growth:
1
Growth Rate:
33.33%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%
Total runs:
3
Run Growth:
3
Growth Rate:
100.00%
Total runs:
3
Run Growth:
3
Growth Rate:
100.00%
Total runs:
3
Run Growth:
3
Growth Rate:
100.00%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%
Total runs:
2
Run Growth:
2
Growth Rate:
100.00%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
-5
Growth Rate:
-250.00%
Total runs:
2
Run Growth:
-2
Growth Rate:
-100.00%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
1
Growth Rate:
50.00%
Total runs:
2
Run Growth:
-4
Growth Rate:
-200.00%
Total runs:
2
Run Growth:
-2
Growth Rate:
-100.00%
Total runs:
2
Run Growth:
-2
Growth Rate:
-100.00%
Total runs:
1
Run Growth:
1
Growth Rate:
100.00%
Total runs:
1
Run Growth:
-2
Growth Rate:
-200.00%