Total runs:
64.4K
Run Growth:
11.5K
Growth Rate:
17.92%
Sponsored by
PoYo.AI
QuantFactory / L3.1-Celestial-Stone-2x8B-DPO-GGUF
Model's Last Updated: September 18 2024
Introduction of L3.1-Celestial-Stone-2x8B-DPO-GGUF
Model Details of L3.1-Celestial-Stone-2x8B-DPO-GGUF
QuantFactory/L3.1-Celestial-Stone-2x8B-DPO-GGUF
This is quantized version of v000000/L3.1-Celestial-Stone-2x8B-DPO created using llama.cpp
Original Model Card
Sampler:
Likes a low temperature due to the MoE architecture. I use 0.3 personally.
Llama-3.1-Celestial-Stone-2x8B-DPO (BF16)
- DPO Trained, Mixture of Experts (14B).
- Direct Preference Optimization run
----> Q6_K
L3.1-Celestial-Stone-2x8B Finetuned on Nvidia A100.
0.5 Epoch completed of dataset jondurbin/gutenberg-dpo-v0.1 with learning_rate=8e-6
Result seems pretty good. More compliant and verbose, less sloppy and safety aligned.
The first expert is Instruct 405B distillation/RP vector merge (Supernova-Lite, Niitama1.1, Storm)
The second expert is ERP/Reddit data merge (Celeste1.5, Stheno3.4, Storm)
The base model is Sao10k/L3.1-Stheno-3.4 with the Sunfall LoRa 0.6.1 to make it understand SillyTavern prompts and storywriting better.
Resultant merge finetuned on jondurbin/gutenberg-dpo-v0.1 .
Prompt Template:
<|begin_of_text|><|start_header_id|>system<|end_header_id|>
{system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>
{input}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
{output}<|eot_id|>
Runs of QuantFactory L3.1-Celestial-Stone-2x8B-DPO-GGUF on huggingface.co
1.0K
Total runs
-18
24-hour runs
2
3-day runs
-24
7-day runs
514
30-day runs
More Information About L3.1-Celestial-Stone-2x8B-DPO-GGUF huggingface.co Model
Url of L3.1-Celestial-Stone-2x8B-DPO-GGUF
L3.1-Celestial-Stone-2x8B-DPO-GGUF huggingface.co Url
Provider of L3.1-Celestial-Stone-2x8B-DPO-GGUF huggingface.co
Other API from QuantFactory
Updated:July 26 2024
Total runs:
22.7K
Run Growth:
8.3K
Growth Rate:
36.47%
Total runs:
14.0K
Run Growth:
4.8K
Growth Rate:
34.13%
Total runs:
13.1K
Run Growth:
1.3K
Growth Rate:
9.94%
Total runs:
9.6K
Run Growth:
5.5K
Growth Rate:
57.40%
Total runs:
9.4K
Run Growth:
919
Growth Rate:
9.95%
Total runs:
9.2K
Run Growth:
5.5K
Growth Rate:
58.82%
Total runs:
9.0K
Run Growth:
3.0K
Growth Rate:
32.80%
Total runs:
8.7K
Run Growth:
6.9K
Growth Rate:
79.93%
Total runs:
5.3K
Run Growth:
1.4K
Growth Rate:
25.70%
Total runs:
4.9K
Run Growth:
3.4K
Growth Rate:
69.50%
Total runs:
3.9K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3.8K
Run Growth:
426
Growth Rate:
11.34%
Total runs:
3.7K
Run Growth:
2.0K
Growth Rate:
53.85%
Total runs:
3.5K
Run Growth:
3.3K
Growth Rate:
93.17%
Total runs:
3.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3.1K
Run Growth:
2.4K
Growth Rate:
75.03%
Total runs:
3.1K
Run Growth:
-1.6K
Growth Rate:
-53.12%
Total runs:
3.1K
Run Growth:
999
Growth Rate:
32.48%
Total runs:
3.0K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3.0K
Run Growth:
543
Growth Rate:
18.25%
Total runs:
3.0K
Run Growth:
-109
Growth Rate:
-3.50%
Total runs:
3.0K
Run Growth:
-383
Growth Rate:
-12.89%
Total runs:
3.0K
Run Growth:
189
Growth Rate:
6.38%
Total runs:
2.9K
Run Growth:
-55
Growth Rate:
-1.89%
Total runs:
2.8K
Run Growth:
104
Growth Rate:
3.71%
Total runs:
2.7K
Run Growth:
42
Growth Rate:
1.53%
Total runs:
2.7K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.7K
Run Growth:
410
Growth Rate:
15.47%
Total runs:
2.6K
Run Growth:
-431
Growth Rate:
-16.48%
Total runs:
2.6K
Run Growth:
1.6K
Growth Rate:
63.05%
Total runs:
2.5K
Run Growth:
2.2K
Growth Rate:
91.11%
Total runs:
2.4K
Run Growth:
445
Growth Rate:
18.64%
Total runs:
2.4K
Run Growth:
-23
Growth Rate:
-0.97%
Total runs:
2.4K
Run Growth:
-655
Growth Rate:
-27.77%
Total runs:
2.2K
Run Growth:
1.6K
Growth Rate:
74.67%
Total runs:
2.2K
Run Growth:
2.0K
Growth Rate:
89.60%
Total runs:
2.2K
Run Growth:
2.1K
Growth Rate:
97.43%
Total runs:
2.2K
Run Growth:
1.3K
Growth Rate:
61.80%
Total runs:
2.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.0K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.0K
Run Growth:
547
Growth Rate:
26.20%
Total runs:
2.0K
Run Growth:
646
Growth Rate:
32.27%
Total runs:
2.0K
Run Growth:
484
Growth Rate:
25.04%
Total runs:
2.0K
Run Growth:
746
Growth Rate:
37.53%
Total runs:
2.0K
Run Growth:
757
Growth Rate:
38.62%
Total runs:
1.9K
Run Growth:
1.1K
Growth Rate:
56.81%
Total runs:
1.9K
Run Growth:
1.8K
Growth Rate:
96.03%
Total runs:
1.9K
Run Growth:
1.8K
Growth Rate:
96.55%
Total runs:
1.8K
Run Growth:
450
Growth Rate:
24.38%
Total runs:
1.8K
Run Growth:
229
Growth Rate:
12.41%
Total runs:
1.8K
Run Growth:
780
Growth Rate:
42.81%
Total runs:
1.8K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.8K
Run Growth:
-169
Growth Rate:
-9.46%
Total runs:
1.8K
Run Growth:
574
Growth Rate:
32.67%
Total runs:
1.7K
Run Growth:
351
Growth Rate:
20.50%
Total runs:
1.7K
Run Growth:
312
Growth Rate:
17.99%
Total runs:
1.7K
Run Growth:
891
Growth Rate:
49.17%
Total runs:
1.7K
Run Growth:
698
Growth Rate:
41.33%
Total runs:
1.7K
Run Growth:
1.6K
Growth Rate:
96.72%
Total runs:
1.7K
Run Growth:
151
Growth Rate:
9.06%
Total runs:
1.7K
Run Growth:
686
Growth Rate:
41.33%
Total runs:
1.6K
Run Growth:
1.5K
Growth Rate:
91.00%
Total runs:
1.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.6K
Run Growth:
339
Growth Rate:
20.91%
Total runs:
1.6K
Run Growth:
1.6K
Growth Rate:
100.00%
Total runs:
1.6K
Run Growth:
1.1K
Growth Rate:
69.28%
Total runs:
1.6K
Run Growth:
956
Growth Rate:
60.58%
Total runs:
1.6K
Run Growth:
587
Growth Rate:
37.41%
Total runs:
1.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.5K
Run Growth:
1.5K
Growth Rate:
100.00%
Total runs:
1.5K
Run Growth:
974
Growth Rate:
61.96%
Total runs:
1.5K
Run Growth:
896
Growth Rate:
59.57%
Total runs:
1.5K
Run Growth:
905
Growth Rate:
59.93%
Total runs:
1.5K
Run Growth:
1.1K
Growth Rate:
74.46%
Total runs:
1.5K
Run Growth:
791
Growth Rate:
53.59%
Total runs:
1.5K
Run Growth:
738
Growth Rate:
50.48%
Total runs:
1.4K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.4K
Run Growth:
917
Growth Rate:
64.44%
Total runs:
1.4K
Run Growth:
1.1K
Growth Rate:
78.00%
Total runs:
1.4K
Run Growth:
881
Growth Rate:
62.22%
Total runs:
1.4K
Run Growth:
691
Growth Rate:
48.97%
Total runs:
1.4K
Run Growth:
639
Growth Rate:
45.42%
Total runs:
1.4K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.4K
Run Growth:
1.3K
Growth Rate:
93.78%
Total runs:
1.4K
Run Growth:
389
Growth Rate:
27.75%
Total runs:
1.4K
Run Growth:
677
Growth Rate:
45.01%
Total runs:
1.4K
Run Growth:
930
Growth Rate:
68.99%
Total runs:
1.4K
Run Growth:
975
Growth Rate:
70.75%
Total runs:
1.4K
Run Growth:
933
Growth Rate:
67.85%
Total runs:
1.4K
Run Growth:
496
Growth Rate:
36.31%
Total runs:
1.4K
Run Growth:
681
Growth Rate:
50.00%
Total runs:
1.4K
Run Growth:
265
Growth Rate:
19.47%
Total runs:
1.4K
Run Growth:
575
Growth Rate:
42.25%
Total runs:
1.4K
Run Growth:
738
Growth Rate:
54.26%
Total runs:
1.4K
Run Growth:
1.1K
Growth Rate:
78.10%
Total runs:
1.4K
Run Growth:
1.1K
Growth Rate:
81.85%
Total runs:
1.3K
Run Growth:
1.1K
Growth Rate:
84.91%
Total runs:
1.3K
Run Growth:
953
Growth Rate:
71.07%