Total runs:
197
Run Growth:
100
Growth Rate:
50.76%
Sponsored by
iMean AI Trip Planner
Statuo / MN-12b-Lyra-v3-4bpw
Model's Last Updated: August 29 2024
Introduction of MN-12b-Lyra-v3-4bpw
Model Details of MN-12b-Lyra-v3-4bpw
Sao blesses us with another Lyra MN finetune. V2 is my daily driver currently so I'm aching to get this.
This is the 4bpw EXL2 Quant of this model. You can find the original model here.
For the 8bpw version, go here
For the 6bpw version, go here
Ungated. Thanks for the patience!
Mistral-NeMo-12B-Lyra-v3, built on top of Lyra-v2a2 , which itself was built upon Lyra-v2a1 .
Model Versioning
Lyra-v1 [Merge of Custom Roleplay & Instruct Trains, on Different Formats]
|
| [Additional SFT on 10% of Previous Data, Mixed]
v
Lyra-v2a1
|
| [Low Rank SFT Step + Tokenizer Diddling]
v
Lyra-v2a2
|
| [RL Step Performed on Multiturn Sets, Magpie-style Responses by Lyra-v2a2 for Rejected Data]
v
Lyra-v3
This uses a custom ChatML-style prompting Format!
-> What can go wrong?
[INST]system
This is the system prompt.[/INST]
[INST]user
Instructions placed here.[/INST]
[INST]assistant
The model's response will be here.[/INST]
Why this? I had used the wrong configs by accident. The format was meant for an 8B pruned NeMo train, instead it went to this. Oops.
Recommended Samplers:
Temperature: 0.7 - 1.2
min_p: 0.1 - 0.2 # Crucial for NeMo
Recommended Stopping Strings:
<|im_end|>
</s>
Blame messed up Training Configs, oops?
Training Metrics:
- Trained on 4xH100 SXM for 6 Hours.
- Trained for 2 Epochs.
- Effective Global Batch Size: 128.
- Dataset Used: A custom, cleaned mix of Stheno-v3.4's Dataset, focused mainly on multiturn.
Extras
Image Source: AI-Generated with FLUX.1 Dev.
have a nice day.
Runs of Statuo MN-12b-Lyra-v3-4bpw on huggingface.co
4
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
3
30-day runs
More Information About MN-12b-Lyra-v3-4bpw huggingface.co Model
Url of MN-12b-Lyra-v3-4bpw
MN-12b-Lyra-v3-4bpw huggingface.co Url
Provider of MN-12b-Lyra-v3-4bpw huggingface.co
Other API from Statuo
Updated:December 16 2024
Total runs:
33
Run Growth:
-154
Growth Rate:
-466.67%
Total runs:
32
Run Growth:
5
Growth Rate:
15.63%
Total runs:
22
Run Growth:
15
Growth Rate:
65.22%
Total runs:
17
Run Growth:
9
Growth Rate:
52.94%
Total runs:
17
Run Growth:
11
Growth Rate:
64.71%
Total runs:
17
Run Growth:
9
Growth Rate:
52.94%
Total runs:
17
Run Growth:
7
Growth Rate:
41.18%
Total runs:
16
Run Growth:
10
Growth Rate:
62.50%
Total runs:
16
Run Growth:
11
Growth Rate:
64.71%
Total runs:
16
Run Growth:
11
Growth Rate:
64.71%
Total runs:
15
Run Growth:
10
Growth Rate:
62.50%
Total runs:
15
Run Growth:
0
Growth Rate:
0.00%
Total runs:
13
Run Growth:
7
Growth Rate:
53.85%
Total runs:
13
Run Growth:
4
Growth Rate:
30.77%
Total runs:
13
Run Growth:
7
Growth Rate:
53.85%
Total runs:
12
Run Growth:
0
Growth Rate:
0.00%
Total runs:
12
Run Growth:
6
Growth Rate:
50.00%
Total runs:
12
Run Growth:
6
Growth Rate:
50.00%
Total runs:
11
Run Growth:
4
Growth Rate:
36.36%
Total runs:
11
Run Growth:
-1
Growth Rate:
-9.09%
Total runs:
10
Run Growth:
5
Growth Rate:
50.00%
Total runs:
10
Run Growth:
6
Growth Rate:
60.00%
Total runs:
10
Run Growth:
1
Growth Rate:
10.00%
Total runs:
10
Run Growth:
1
Growth Rate:
10.00%
Total runs:
9
Run Growth:
2
Growth Rate:
22.22%
Total runs:
9
Run Growth:
5
Growth Rate:
55.56%
Total runs:
8
Run Growth:
4
Growth Rate:
50.00%
Total runs:
8
Run Growth:
1
Growth Rate:
12.50%
Total runs:
8
Run Growth:
5
Growth Rate:
62.50%
Total runs:
8
Run Growth:
-2
Growth Rate:
-33.33%
Total runs:
8
Run Growth:
1
Growth Rate:
12.50%
Total runs:
8
Run Growth:
3
Growth Rate:
33.33%
Total runs:
8
Run Growth:
0
Growth Rate:
0.00%
Total runs:
7
Run Growth:
3
Growth Rate:
50.00%
Total runs:
7
Run Growth:
4
Growth Rate:
57.14%
Total runs:
7
Run Growth:
3
Growth Rate:
42.86%
Total runs:
7
Run Growth:
-16
Growth Rate:
-266.67%
Total runs:
7
Run Growth:
1
Growth Rate:
20.00%
Total runs:
7
Run Growth:
4
Growth Rate:
66.67%
Total runs:
7
Run Growth:
5
Growth Rate:
83.33%
Total runs:
6
Run Growth:
-1
Growth Rate:
-16.67%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
-1
Growth Rate:
-20.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
-3
Growth Rate:
-75.00%
Total runs:
4
Run Growth:
-3
Growth Rate:
-75.00%
Total runs:
4
Run Growth:
1
Growth Rate:
25.00%
Total runs:
4
Run Growth:
-1
Growth Rate:
-25.00%
Total runs:
4
Run Growth:
1
Growth Rate:
25.00%
Total runs:
4
Run Growth:
1
Growth Rate:
25.00%
Total runs:
4
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
1
Growth Rate:
25.00%
Total runs:
4
Run Growth:
-2
Growth Rate:
-50.00%
Total runs:
4
Run Growth:
1
Growth Rate:
25.00%
Total runs:
4
Run Growth:
3
Growth Rate:
75.00%
Total runs:
4
Run Growth:
2
Growth Rate:
50.00%
Total runs:
4
Run Growth:
1
Growth Rate:
25.00%
Total runs:
4
Run Growth:
2
Growth Rate:
50.00%
Total runs:
4
Run Growth:
2
Growth Rate:
50.00%
Total runs:
4
Run Growth:
4
Growth Rate:
100.00%
Total runs:
3
Run Growth:
1
Growth Rate:
33.33%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%
Total runs:
3
Run Growth:
3
Growth Rate:
100.00%
Total runs:
3
Run Growth:
-1
Growth Rate:
-33.33%
Total runs:
3
Run Growth:
1
Growth Rate:
33.33%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
3
Growth Rate:
100.00%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
3
Growth Rate:
100.00%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%
Total runs:
2
Run Growth:
2
Growth Rate:
100.00%
Total runs:
2
Run Growth:
-1
Growth Rate:
-50.00%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
-5
Growth Rate:
-250.00%
Total runs:
2
Run Growth:
-2
Growth Rate:
-100.00%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
-1
Growth Rate:
-50.00%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
1
Growth Rate:
50.00%
Total runs:
2
Run Growth:
-4
Growth Rate:
-200.00%
Total runs:
2
Run Growth:
-2
Growth Rate:
-100.00%
Total runs:
1
Run Growth:
1
Growth Rate:
100.00%
Total runs:
1
Run Growth:
-2
Growth Rate:
-200.00%