Total runs:
416
Run Growth:
302
Growth Rate:
72.60%
Sponsored by
APIMart
Delta-Vector / Hamanasu-32B-V1-QwQ
Model's Last Updated: March 13 2025
Introduction of Hamanasu-32B-V1-QwQ
Model Details of Hamanasu-32B-V1-QwQ
Hamanasu 32B
🌌 Overview
After 25 hours, I present Hamanasu-QwQ-32B-V0.1 - One of the first QwQ Finetunes. Using data from the following:
-
NewEden/Orion-LIT -
NewEden/Orion-Asstr-Stories-16K -
Mielikki/Erebus-87k
This model shows great promise for roleplaying and story-writing. All thanks to Ruka-Hamanasu for funding the train.
Disclaimer: The model is still in preview, Only completion training has been performed ontop.
💰 Prompting
This model uses ChatML formatting
<|im_start|>system
You are an uncensored AI, your job is to fulfill thy will of thy user.<|im_end|>
<|im_start|>User request
Take off your helmet.<|im_end|>
<|im_start|>No i shall not. This is the way.
Axolotl Config ꒰(˶• ᴗ •˶)꒱
base_model: Qwen/QwQ-32B
model_type: AutoModelForCausalLM
tokenizer_type: AutoTokenizer
plugins:
- axolotl.integrations.liger.LigerPlugin
liger_rope: true
liger_rms_norm: true
liger_swiglu: true
liger_fused_linear_cross_entropy: true
load_in_8bit: false
load_in_4bit: false
strict: false
datasets:
- path: Mielikki/Erebus-87k
type: completion
field: body
- path: NewEden/Orion-Completion-Asstr-Stories-16K
type: completion
field: content
- path: NewEden/Orion-Completion-LIT
type: completion
field: text
shuffle_merged_datasets: true
dataset_prepared_path: prepared_data
output_dir: ./qvq-cum
sequence_len: 16384
sample_packing: true
pad_to_sequence_len: true
adapter: lora
lora_model_dir:
lora_r: 128
lora_alpha: 16
lora_dropout: 0.05
lora_target_modules:
- gate_proj
- down_proj
- up_proj
- q_proj
- v_proj
- k_proj
- o_proj
lora_modules_to_save:
- embed_tokens
- lm_head
wandb_project: qwq
wandb_entity:
wandb_watch:
wandb_name: Pretrain-pt1-v2-frfr
wandb_log_model:
gradient_accumulation_steps: 2
micro_batch_size: 2
num_epochs: 1
optimizer: paged_adamw_8bit
lr_scheduler: cosine
learning_rate: 1e-5
max_grad_norm: 0.001
train_on_inputs: false
group_by_length: false
bf16: auto
fp16:
tf32: false
gradient_checkpointing: true
early_stopping_patience:
resume_from_checkpoint:
local_rank:
logging_steps: 1
xformers_attention:
flash_attention: true
warmup_steps: 40
saves_per_epoch: 2
debug:
deepspeed: /workspace/axolotl/deepspeed_configs/zero3_bf16.json
weight_decay: 0.01
fsdp:
fsdp_config:
Runs of Delta-Vector Hamanasu-32B-V1-QwQ on huggingface.co
26
Total runs
0
24-hour runs
1
3-day runs
7
7-day runs
10
30-day runs
More Information About Hamanasu-32B-V1-QwQ huggingface.co Model
Url of Hamanasu-32B-V1-QwQ
Hamanasu-32B-V1-QwQ huggingface.co Url
Provider of Hamanasu-32B-V1-QwQ huggingface.co
Other API from Delta-Vector
Updated:September 28 2025
Total runs:
322
Run Growth:
0
Growth Rate:
0.00%
Total runs:
206
Run Growth:
0
Growth Rate:
0.00%
Total runs:
202
Run Growth:
114
Growth Rate:
56.44%
Total runs:
144
Run Growth:
0
Growth Rate:
0.00%
Total runs:
119
Run Growth:
82
Growth Rate:
68.91%
Total runs:
113
Run Growth:
96
Growth Rate:
84.96%
Total runs:
106
Run Growth:
0
Growth Rate:
0.00%
Total runs:
98
Run Growth:
49
Growth Rate:
50.00%
Total runs:
91
Run Growth:
58
Growth Rate:
63.74%
Total runs:
89
Run Growth:
0
Growth Rate:
0.00%
Total runs:
85
Run Growth:
-7
Growth Rate:
-8.24%
Total runs:
75
Run Growth:
12
Growth Rate:
16.00%
Total runs:
75
Run Growth:
-29
Growth Rate:
-38.67%
Total runs:
74
Run Growth:
0
Growth Rate:
0.00%
Total runs:
68
Run Growth:
0
Growth Rate:
0.00%
Total runs:
64
Run Growth:
0
Growth Rate:
0.00%
Total runs:
61
Run Growth:
0
Growth Rate:
0.00%
Total runs:
57
Run Growth:
0
Growth Rate:
0.00%
Total runs:
57
Run Growth:
0
Growth Rate:
0.00%
Total runs:
54
Run Growth:
0
Growth Rate:
0.00%
Total runs:
48
Run Growth:
32
Growth Rate:
66.67%
Total runs:
47
Run Growth:
0
Growth Rate:
0.00%
Total runs:
45
Run Growth:
6
Growth Rate:
13.33%
Total runs:
44
Run Growth:
0
Growth Rate:
0.00%
Total runs:
43
Run Growth:
-12
Growth Rate:
-27.91%
Total runs:
43
Run Growth:
36
Growth Rate:
83.72%
Total runs:
42
Run Growth:
19
Growth Rate:
45.24%
Total runs:
40
Run Growth:
0
Growth Rate:
0.00%
Total runs:
40
Run Growth:
30
Growth Rate:
75.00%
Total runs:
39
Run Growth:
10
Growth Rate:
25.64%
Total runs:
37
Run Growth:
21
Growth Rate:
56.76%
Total runs:
36
Run Growth:
25
Growth Rate:
69.44%
Total runs:
36
Run Growth:
24
Growth Rate:
66.67%
Total runs:
35
Run Growth:
0
Growth Rate:
0.00%
Total runs:
35
Run Growth:
0
Growth Rate:
0.00%
Total runs:
34
Run Growth:
1
Growth Rate:
2.94%
Total runs:
34
Run Growth:
6
Growth Rate:
17.65%
Total runs:
34
Run Growth:
-8
Growth Rate:
-23.53%
Total runs:
33
Run Growth:
24
Growth Rate:
72.73%
Total runs:
32
Run Growth:
0
Growth Rate:
0.00%
Total runs:
31
Run Growth:
0
Growth Rate:
0.00%
Total runs:
31
Run Growth:
0
Growth Rate:
0.00%
Total runs:
31
Run Growth:
13
Growth Rate:
41.94%
Total runs:
31
Run Growth:
-50
Growth Rate:
-161.29%
Total runs:
30
Run Growth:
20
Growth Rate:
66.67%
Total runs:
30
Run Growth:
0
Growth Rate:
0.00%
Total runs:
30
Run Growth:
0
Growth Rate:
0.00%
Total runs:
30
Run Growth:
17
Growth Rate:
56.67%
Total runs:
30
Run Growth:
13
Growth Rate:
43.33%
Total runs:
29
Run Growth:
18
Growth Rate:
62.07%
Total runs:
27
Run Growth:
12
Growth Rate:
44.44%
Total runs:
27
Run Growth:
4
Growth Rate:
14.81%
Total runs:
27
Run Growth:
-13
Growth Rate:
-48.15%
Total runs:
26
Run Growth:
0
Growth Rate:
0.00%
Total runs:
26
Run Growth:
-17
Growth Rate:
-65.38%
Total runs:
26
Run Growth:
0
Growth Rate:
0.00%
Total runs:
26
Run Growth:
-5
Growth Rate:
-19.23%
Total runs:
26
Run Growth:
0
Growth Rate:
0.00%
Total runs:
26
Run Growth:
0
Growth Rate:
0.00%
Total runs:
25
Run Growth:
0
Growth Rate:
0.00%
Total runs:
25
Run Growth:
17
Growth Rate:
68.00%
Total runs:
24
Run Growth:
17
Growth Rate:
70.83%
Total runs:
24
Run Growth:
0
Growth Rate:
0.00%
Total runs:
24
Run Growth:
0
Growth Rate:
0.00%
Total runs:
24
Run Growth:
14
Growth Rate:
58.33%
Total runs:
23
Run Growth:
0
Growth Rate:
0.00%
Total runs:
23
Run Growth:
0
Growth Rate:
0.00%
Total runs:
23
Run Growth:
0
Growth Rate:
0.00%
Total runs:
23
Run Growth:
-133
Growth Rate:
-578.26%
Total runs:
23
Run Growth:
13
Growth Rate:
56.52%
Total runs:
22
Run Growth:
0
Growth Rate:
0.00%