Total runs:
322
Run Growth:
0
Growth Rate:
0.00%
Sponsored by
PoYo.AI
Delta-Vector / Austral-24B-Winton
Model's Last Updated: July 03 2025
text-generation
Introduction of Austral-24B-Winton
Model Details of Austral-24B-Winton
Austral 24B Winton
Trained by
Delta-Vector
Overview
Austral 24B - Winton
Harbinger Finetune
Mistral Based
KTO enhanced
Adventure/Roleplay generalist
24B Sized model
More than 1.5-metres tall, about six-metres long and up to 1000-kilograms heavy, Australovenator Wintonensis was a fast and agile hunter. The largest known Australian theropod.
This is a finetune of Harbinger 24B to be a generalist Roleplay/Adventure model. I've removed some of the "slops" that i noticed in an otherwise great model aswell as improving the general writing of the model, This was a multi-stage finetune, all previous checkpoints are released aswell.
Support my finetunes / Me on Kofi: https://Ko-fi.com/deltavector | Thank you to Auri for helping/Testing ♥
Quants
Chat Format
This model utilizes ChatML.
<|im_start|>user
Hi there!<|im_end|>
<|im_start|>assistant
Nice to meet you!<|im_end|>
<|im_start|>user
Can I ask a question?<|im_end|>
<|im_start|>assistantTraining
As the the Austral/Francois tradition, I built off another great finetune Harbinger-24B, I did 4 epochs ontop with roughly the same datamix as Francois-Huali/Austral 70B as a R128 Lora, then KTO alignment with a mix of Instruct/Small writing datasets and then finally another 4 epoch SFT with Rep_remover (Thanks Pocket!)
Config(Post-KTO SFT)
https://wandb.ai/new-eden/austral/artifacts/axolotl-config/config-0tzehrhe/v0/files/axolotl_config_m8018fm4.ymlThis model was trained over 4 epochs using 8 x A100s for the base SFT, Then i used KTO to clean up some coherency issues for 1 epoch, then finally training for another 4 epochs on Rep_Remover to delete slops. Total was roughly 80 hours total.
Credits
TYSM to my friends: Auri, Lucy, Trappu, Alicat, Kubernetes Bad, Intervitens, NyxKrage & Kalomaze
Runs of Delta-Vector Austral-24B-Winton on huggingface.co
33
Total runs
0
24-hour runs
-2
3-day runs
-5
7-day runs
10
30-day runs
More Information About Austral-24B-Winton huggingface.co Model
Url of Austral-24B-Winton
Austral-24B-Winton huggingface.co Url
Provider of Austral-24B-Winton huggingface.co
Other API from Delta-Vector
Updated:April 01 2025
Total runs:
217
Run Growth:
202
Growth Rate:
93.09%
Total runs:
206
Run Growth:
0
Growth Rate:
0.00%
Total runs:
144
Run Growth:
0
Growth Rate:
0.00%
Total runs:
116
Run Growth:
-6
Growth Rate:
-5.17%
Total runs:
106
Run Growth:
0
Growth Rate:
0.00%
Total runs:
98
Run Growth:
49
Growth Rate:
50.00%
Total runs:
91
Run Growth:
58
Growth Rate:
63.74%
Total runs:
89
Run Growth:
0
Growth Rate:
0.00%
Total runs:
87
Run Growth:
43
Growth Rate:
49.43%
Total runs:
78
Run Growth:
70
Growth Rate:
89.74%
Total runs:
75
Run Growth:
12
Growth Rate:
16.00%
Total runs:
75
Run Growth:
-29
Growth Rate:
-38.67%
Total runs:
74
Run Growth:
0
Growth Rate:
0.00%
Total runs:
68
Run Growth:
0
Growth Rate:
0.00%
Total runs:
64
Run Growth:
0
Growth Rate:
0.00%
Total runs:
61
Run Growth:
0
Growth Rate:
0.00%
Total runs:
58
Run Growth:
-31
Growth Rate:
-50.82%
Total runs:
57
Run Growth:
0
Growth Rate:
0.00%
Total runs:
57
Run Growth:
0
Growth Rate:
0.00%
Total runs:
57
Run Growth:
35
Growth Rate:
74.47%
Total runs:
54
Run Growth:
0
Growth Rate:
0.00%
Total runs:
50
Run Growth:
29
Growth Rate:
58.00%
Total runs:
49
Run Growth:
35
Growth Rate:
67.31%
Total runs:
48
Run Growth:
32
Growth Rate:
66.67%
Total runs:
47
Run Growth:
0
Growth Rate:
0.00%
Total runs:
45
Run Growth:
6
Growth Rate:
13.33%
Total runs:
44
Run Growth:
34
Growth Rate:
77.27%
Total runs:
44
Run Growth:
0
Growth Rate:
0.00%
Total runs:
43
Run Growth:
36
Growth Rate:
83.72%
Total runs:
42
Run Growth:
24
Growth Rate:
57.14%
Total runs:
42
Run Growth:
19
Growth Rate:
45.24%
Total runs:
40
Run Growth:
0
Growth Rate:
0.00%
Total runs:
35
Run Growth:
0
Growth Rate:
0.00%
Total runs:
35
Run Growth:
0
Growth Rate:
0.00%
Total runs:
34
Run Growth:
6
Growth Rate:
17.65%
Total runs:
34
Run Growth:
18
Growth Rate:
52.94%
Total runs:
33
Run Growth:
24
Growth Rate:
72.73%
Total runs:
32
Run Growth:
16
Growth Rate:
50.00%
Total runs:
32
Run Growth:
0
Growth Rate:
0.00%
Total runs:
31
Run Growth:
0
Growth Rate:
0.00%
Total runs:
31
Run Growth:
0
Growth Rate:
0.00%
Total runs:
30
Run Growth:
0
Growth Rate:
0.00%
Total runs:
30
Run Growth:
0
Growth Rate:
0.00%
Total runs:
28
Run Growth:
4
Growth Rate:
14.29%
Total runs:
28
Run Growth:
15
Growth Rate:
53.57%
Total runs:
26
Run Growth:
0
Growth Rate:
0.00%
Total runs:
26
Run Growth:
0
Growth Rate:
0.00%
Total runs:
26
Run Growth:
-5
Growth Rate:
-19.23%
Total runs:
26
Run Growth:
0
Growth Rate:
0.00%
Total runs:
26
Run Growth:
0
Growth Rate:
0.00%
Total runs:
25
Run Growth:
0
Growth Rate:
0.00%
Total runs:
24
Run Growth:
0
Growth Rate:
0.00%
Total runs:
24
Run Growth:
0
Growth Rate:
0.00%
Total runs:
23
Run Growth:
0
Growth Rate:
0.00%
Total runs:
23
Run Growth:
0
Growth Rate:
0.00%
Total runs:
23
Run Growth:
0
Growth Rate:
0.00%
Total runs:
23
Run Growth:
-133
Growth Rate:
-578.26%
Total runs:
22
Run Growth:
0
Growth Rate:
0.00%
Total runs:
22
Run Growth:
0
Growth Rate:
0.00%
Total runs:
22
Run Growth:
0
Growth Rate:
0.00%
Total runs:
22
Run Growth:
0
Growth Rate:
0.00%
Total runs:
21
Run Growth:
4
Growth Rate:
19.05%
Total runs:
21
Run Growth:
0
Growth Rate:
0.00%
Total runs:
21
Run Growth:
-68
Growth Rate:
-323.81%
Total runs:
20
Run Growth:
7
Growth Rate:
35.00%
Total runs:
20
Run Growth:
0
Growth Rate:
0.00%
Total runs:
20
Run Growth:
8
Growth Rate:
40.00%
Total runs:
20
Run Growth:
4
Growth Rate:
20.00%
Total runs:
20
Run Growth:
0
Growth Rate:
0.00%
Total runs:
20
Run Growth:
0
Growth Rate:
0.00%
Total runs:
20
Run Growth:
0
Growth Rate:
0.00%
Total runs:
20
Run Growth:
10
Growth Rate:
50.00%
Total runs:
19
Run Growth:
0
Growth Rate:
0.00%
Total runs:
18
Run Growth:
0
Growth Rate:
0.00%
Total runs:
18
Run Growth:
13
Growth Rate:
72.22%
Total runs:
18
Run Growth:
8
Growth Rate:
42.11%
Total runs:
18
Run Growth:
4
Growth Rate:
22.22%