Total runs:
397
Run Growth:
282
Growth Rate:
71.03%
Sponsored by
AdsCreator.com
Delta-Vector / Hamanasu-15B-R2-PT
Model's Last Updated: February 15 2025
Introduction of Hamanasu-15B-R2-PT
Model Details of Hamanasu-15B-R2-PT
Hamanasu 15B R2 PT
🌌 Overview
This is the 2nd pretrain of Phi-4 Continued from the Orginal Asstr-Erebus Pretrain. This pretrain used 500 million tokens from
-
NewEden/Orion-LIT
This model has not been instruct tuned, Ablities to converse may be reduced from the original model, If you would like to roleplay, Please use the Instruct version.
Axolotl Config ꒰(˶• ᴗ •˶)꒱
base_model: Hamanasu-15B-R2-PT
model_type: AutoModelForCausalLM
tokenizer_type: AutoTokenizer
#hub_model_id: NewEden/Phi4-pretrain
#hub_strategy: "all_checkpoints"
#push_dataset_to_hub:
#hf_use_auth_token: true
plugins:
- axolotl.integrations.liger.LigerPlugin
liger_rope: true
liger_rms_norm: true
liger_swiglu: true
liger_fused_linear_cross_entropy: true
#plugins:
# - axolotl.integrations.cut_cross_entropy.CutCrossEntropyPlugin
#cut_cross_entropy: true
load_in_8bit: false
load_in_4bit: false
strict: false
datasets:
- path: NewEden/Orion-LIT
type: completion
field: text
shuffle_merged_datasets: true
dataset_prepared_path: prepared_data
val_set_size: 0.0
output_dir: ./phi4-ptv2-out-r1
sequence_len: 16384
sample_packing: true
pad_to_sequence_len: true
adapter: lora
lora_model_dir:
lora_r: 128
lora_alpha: 16
lora_dropout: 0.05
lora_target_modules:
- gate_proj
- down_proj
- up_proj
- q_proj
- v_proj
- k_proj
- o_proj
lora_modules_to_save:
- embed_tokens
- lm_head
wandb_project: mag-phi
wandb_entity:
wandb_watch:
wandb_name: comp-v2-attempt-01
wandb_log_model:
gradient_accumulation_steps: 4
micro_batch_size: 2
num_epochs: 1
optimizer: paged_ademamix_8bit
lr_scheduler: cosine
learning_rate: 0.00002
train_on_inputs: false
group_by_length: false
bf16: auto
fp16:
tf32: false
gradient_checkpointing: unsloth
early_stopping_patience:
resume_from_checkpoint:
local_rank:
logging_steps: 1
xformers_attention:
flash_attention: true
warmup_steps: 15
evals_per_epoch: 4
eval_table_size:
eval_max_new_tokens: 128
saves_per_epoch: 4
debug:
deepspeed: /workspace/axolotl/deepspeed_configs/zero3_bf16_cpuoffload_params.json
weight_decay: 0.01
fsdp:
fsdp_config:
Runs of Delta-Vector Hamanasu-15B-R2-PT on huggingface.co
21
Total runs
0
24-hour runs
-1
3-day runs
4
7-day runs
12
30-day runs
More Information About Hamanasu-15B-R2-PT huggingface.co Model
Url of Hamanasu-15B-R2-PT
Hamanasu-15B-R2-PT huggingface.co Url
Provider of Hamanasu-15B-R2-PT huggingface.co
Other API from Delta-Vector
Updated:September 28 2025
Total runs:
322
Run Growth:
0
Growth Rate:
0.00%
Total runs:
206
Run Growth:
0
Growth Rate:
0.00%
Total runs:
202
Run Growth:
114
Growth Rate:
56.44%
Total runs:
144
Run Growth:
0
Growth Rate:
0.00%
Total runs:
117
Run Growth:
77
Growth Rate:
65.81%
Total runs:
113
Run Growth:
103
Growth Rate:
88.03%
Total runs:
106
Run Growth:
0
Growth Rate:
0.00%
Total runs:
98
Run Growth:
49
Growth Rate:
50.00%
Total runs:
91
Run Growth:
58
Growth Rate:
63.74%
Total runs:
89
Run Growth:
0
Growth Rate:
0.00%
Total runs:
86
Run Growth:
-5
Growth Rate:
-5.81%
Total runs:
75
Run Growth:
12
Growth Rate:
16.00%
Total runs:
75
Run Growth:
-29
Growth Rate:
-38.67%
Total runs:
74
Run Growth:
0
Growth Rate:
0.00%
Total runs:
68
Run Growth:
0
Growth Rate:
0.00%
Total runs:
64
Run Growth:
0
Growth Rate:
0.00%
Total runs:
61
Run Growth:
0
Growth Rate:
0.00%
Total runs:
57
Run Growth:
0
Growth Rate:
0.00%
Total runs:
57
Run Growth:
0
Growth Rate:
0.00%
Total runs:
54
Run Growth:
0
Growth Rate:
0.00%
Total runs:
48
Run Growth:
32
Growth Rate:
66.67%
Total runs:
47
Run Growth:
0
Growth Rate:
0.00%
Total runs:
45
Run Growth:
6
Growth Rate:
13.33%
Total runs:
44
Run Growth:
0
Growth Rate:
0.00%
Total runs:
43
Run Growth:
4
Growth Rate:
7.41%
Total runs:
43
Run Growth:
36
Growth Rate:
83.72%
Total runs:
42
Run Growth:
19
Growth Rate:
45.24%
Total runs:
40
Run Growth:
0
Growth Rate:
0.00%
Total runs:
40
Run Growth:
29
Growth Rate:
72.50%
Total runs:
39
Run Growth:
7
Growth Rate:
18.42%
Total runs:
37
Run Growth:
22
Growth Rate:
57.89%
Total runs:
36
Run Growth:
14
Growth Rate:
53.85%
Total runs:
36
Run Growth:
23
Growth Rate:
63.89%
Total runs:
35
Run Growth:
0
Growth Rate:
0.00%
Total runs:
35
Run Growth:
0
Growth Rate:
0.00%
Total runs:
34
Run Growth:
1
Growth Rate:
2.94%
Total runs:
34
Run Growth:
6
Growth Rate:
17.65%
Total runs:
34
Run Growth:
-9
Growth Rate:
-27.27%
Total runs:
33
Run Growth:
24
Growth Rate:
72.73%
Total runs:
32
Run Growth:
0
Growth Rate:
0.00%
Total runs:
32
Run Growth:
14
Growth Rate:
43.75%
Total runs:
32
Run Growth:
15
Growth Rate:
46.88%
Total runs:
32
Run Growth:
-48
Growth Rate:
-150.00%
Total runs:
31
Run Growth:
0
Growth Rate:
0.00%
Total runs:
31
Run Growth:
0
Growth Rate:
0.00%
Total runs:
30
Run Growth:
19
Growth Rate:
63.33%
Total runs:
30
Run Growth:
0
Growth Rate:
0.00%
Total runs:
30
Run Growth:
0
Growth Rate:
0.00%
Total runs:
30
Run Growth:
16
Growth Rate:
53.33%
Total runs:
28
Run Growth:
-15
Growth Rate:
-53.57%
Total runs:
28
Run Growth:
-9
Growth Rate:
-32.14%
Total runs:
27
Run Growth:
11
Growth Rate:
40.74%
Total runs:
27
Run Growth:
4
Growth Rate:
14.81%
Total runs:
26
Run Growth:
0
Growth Rate:
0.00%
Total runs:
26
Run Growth:
0
Growth Rate:
0.00%
Total runs:
26
Run Growth:
-5
Growth Rate:
-19.23%
Total runs:
26
Run Growth:
8
Growth Rate:
32.00%
Total runs:
26
Run Growth:
0
Growth Rate:
0.00%
Total runs:
26
Run Growth:
0
Growth Rate:
0.00%
Total runs:
25
Run Growth:
0
Growth Rate:
0.00%
Total runs:
25
Run Growth:
16
Growth Rate:
64.00%
Total runs:
24
Run Growth:
16
Growth Rate:
66.67%
Total runs:
24
Run Growth:
0
Growth Rate:
0.00%
Total runs:
24
Run Growth:
0
Growth Rate:
0.00%
Total runs:
24
Run Growth:
12
Growth Rate:
50.00%
Total runs:
23
Run Growth:
0
Growth Rate:
0.00%
Total runs:
23
Run Growth:
0
Growth Rate:
0.00%
Total runs:
23
Run Growth:
0
Growth Rate:
0.00%
Total runs:
23
Run Growth:
-133
Growth Rate:
-578.26%
Total runs:
23
Run Growth:
12
Growth Rate:
52.17%
Total runs:
22
Run Growth:
0
Growth Rate:
0.00%