Total runs:
1.0K
Run Growth:
161
Growth Rate:
15.89%
Sponsored by
APIMart
nbeerbower / Qwen3-Gutenberg-Encore-14B
Model's Last Updated: June 06 2025
text-generation
Introduction of Qwen3-Gutenberg-Encore-14B
Model Details of Qwen3-Gutenberg-Encore-14B
Qwen3-Gutenberg-Encore-14B
nbeerbower/Xiaolong-Qwen3-14B finetuned on:
- jondurbin/gutenberg-dpo-v0.1
- nbeerbower/gutenberg2-dpo
- nbeerbower/gutenberg-moderne-dpo
- nbeerbower/synthetic-fiction-dpo
- nbeerbower/Arkhaios-DPO
- nbeerbower/Purpura-DPO
- nbeerbower/Schule-DPO
Method
ORPO tuned with 1x RTX A6000 for 3 epochs.
QLoRA config
# QLoRA config
bnb_config = BitsAndBytesConfig(
load_in_4bit=True,
bnb_4bit_quant_type="nf4",
bnb_4bit_compute_dtype=torch_dtype,
bnb_4bit_use_double_quant=True,
)
# LoRA config
peft_config = LoraConfig(
r=64,
lora_alpha=128,
lora_dropout=0.05,
bias="none",
task_type="CAUSAL_LM",
target_modules=['up_proj', 'down_proj', 'gate_proj', 'k_proj', 'q_proj', 'v_proj', 'o_proj']
)
ORPO config
orpo_args = ORPOConfig(
learning_rate=8e-6,
lr_scheduler_type="cosine",
warmup_ratio=0.05,
max_length=4096,
max_prompt_length=1024,
max_completion_length=4096,
beta=0.1,
per_device_train_batch_size=1,
per_device_eval_batch_size=1,
gradient_accumulation_steps=64,
optim="paged_adamw_8bit",
num_train_epochs=3,
max_grad_norm=0.5,
bf16=True,
)
Runs of nbeerbower Qwen3-Gutenberg-Encore-14B on huggingface.co
46
Total runs
0
24-hour runs
0
3-day runs
3
7-day runs
22
30-day runs
More Information About Qwen3-Gutenberg-Encore-14B huggingface.co Model
Url of Qwen3-Gutenberg-Encore-14B
Qwen3-Gutenberg-Encore-14B huggingface.co Url
Provider of Qwen3-Gutenberg-Encore-14B huggingface.co
Other API from nbeerbower
Updated:June 10 2025
Total runs:
399
Run Growth:
293
Growth Rate:
73.43%
Total runs:
270
Run Growth:
270
Growth Rate:
100.00%
Total runs:
187
Run Growth:
101
Growth Rate:
52.88%
Total runs:
145
Run Growth:
-25
Growth Rate:
-17.36%
Total runs:
135
Run Growth:
-42
Growth Rate:
-31.11%
Total runs:
116
Run Growth:
-32
Growth Rate:
-27.59%
Total runs:
104
Run Growth:
-307
Growth Rate:
-289.62%
Total runs:
100
Run Growth:
69
Growth Rate:
69.00%
Total runs:
94
Run Growth:
22
Growth Rate:
23.40%
Total runs:
93
Run Growth:
6
Growth Rate:
6.45%
Total runs:
86
Run Growth:
43
Growth Rate:
51.19%
Total runs:
85
Run Growth:
0
Growth Rate:
0.00%
Total runs:
83
Run Growth:
-3
Growth Rate:
-3.61%
Total runs:
73
Run Growth:
35
Growth Rate:
47.95%
Total runs:
72
Run Growth:
28
Growth Rate:
41.79%
Total runs:
71
Run Growth:
25
Growth Rate:
35.71%
Total runs:
69
Run Growth:
35
Growth Rate:
51.47%
Total runs:
68
Run Growth:
-22
Growth Rate:
-32.35%
Total runs:
67
Run Growth:
-2
Growth Rate:
-2.99%
Total runs:
67
Run Growth:
52
Growth Rate:
77.61%
Total runs:
67
Run Growth:
-19
Growth Rate:
-28.79%
Total runs:
66
Run Growth:
5
Growth Rate:
7.58%
Total runs:
65
Run Growth:
-114
Growth Rate:
-178.13%
Total runs:
64
Run Growth:
-182
Growth Rate:
-288.89%
Total runs:
63
Run Growth:
-2
Growth Rate:
-3.17%
Total runs:
62
Run Growth:
11
Growth Rate:
17.74%
Total runs:
62
Run Growth:
25
Growth Rate:
43.10%
Total runs:
61
Run Growth:
18
Growth Rate:
30.00%
Total runs:
60
Run Growth:
38
Growth Rate:
64.41%
Total runs:
58
Run Growth:
52
Growth Rate:
89.66%
Total runs:
58
Run Growth:
18
Growth Rate:
32.14%
Total runs:
53
Run Growth:
-31
Growth Rate:
-58.49%
Total runs:
52
Run Growth:
33
Growth Rate:
66.00%
Total runs:
51
Run Growth:
21
Growth Rate:
42.00%
Total runs:
51
Run Growth:
21
Growth Rate:
42.00%
Total runs:
50
Run Growth:
11
Growth Rate:
22.00%
Total runs:
50
Run Growth:
21
Growth Rate:
42.86%
Total runs:
50
Run Growth:
31
Growth Rate:
63.27%
Total runs:
50
Run Growth:
8
Growth Rate:
16.33%
Total runs:
49
Run Growth:
47
Growth Rate:
95.92%
Total runs:
49
Run Growth:
34
Growth Rate:
69.39%
Total runs:
48
Run Growth:
24
Growth Rate:
50.00%
Total runs:
48
Run Growth:
10
Growth Rate:
21.28%
Total runs:
48
Run Growth:
8
Growth Rate:
16.67%
Total runs:
48
Run Growth:
28
Growth Rate:
58.33%
Total runs:
48
Run Growth:
5
Growth Rate:
10.87%
Total runs:
48
Run Growth:
8
Growth Rate:
17.02%
Total runs:
47
Run Growth:
-9
Growth Rate:
-20.00%
Total runs:
47
Run Growth:
21
Growth Rate:
44.68%
Total runs:
47
Run Growth:
25
Growth Rate:
53.19%
Total runs:
47
Run Growth:
47
Growth Rate:
100.00%
Total runs:
46
Run Growth:
39
Growth Rate:
84.78%
Total runs:
46
Run Growth:
14
Growth Rate:
30.43%
Total runs:
45
Run Growth:
23
Growth Rate:
51.11%
Total runs:
44
Run Growth:
9
Growth Rate:
20.45%
Total runs:
44
Run Growth:
14
Growth Rate:
31.82%
Total runs:
44
Run Growth:
2
Growth Rate:
4.76%
Total runs:
43
Run Growth:
4
Growth Rate:
9.52%
Total runs:
43
Run Growth:
21
Growth Rate:
48.84%
Total runs:
42
Run Growth:
23
Growth Rate:
56.10%
Total runs:
41
Run Growth:
0
Growth Rate:
0.00%
Total runs:
41
Run Growth:
13
Growth Rate:
32.50%
Total runs:
40
Run Growth:
21
Growth Rate:
51.22%
Total runs:
39
Run Growth:
23
Growth Rate:
58.97%
Total runs:
39
Run Growth:
20
Growth Rate:
51.28%
Total runs:
39
Run Growth:
21
Growth Rate:
53.85%
Total runs:
39
Run Growth:
6
Growth Rate:
15.38%
Total runs:
38
Run Growth:
19
Growth Rate:
51.35%
Total runs:
38
Run Growth:
19
Growth Rate:
54.29%
Total runs:
37
Run Growth:
21
Growth Rate:
56.76%
Total runs:
37
Run Growth:
25
Growth Rate:
67.57%
Total runs:
36
Run Growth:
25
Growth Rate:
69.44%
Total runs:
36
Run Growth:
24
Growth Rate:
66.67%
Total runs:
35
Run Growth:
-3
Growth Rate:
-8.57%
Total runs:
35
Run Growth:
22
Growth Rate:
62.86%
Total runs:
35
Run Growth:
13
Growth Rate:
37.14%
Total runs:
34
Run Growth:
25
Growth Rate:
73.53%
Total runs:
34
Run Growth:
20
Growth Rate:
55.56%
Total runs:
34
Run Growth:
19
Growth Rate:
55.88%
Total runs:
33
Run Growth:
12
Growth Rate:
38.71%
Total runs:
33
Run Growth:
-6
Growth Rate:
-18.18%
Total runs:
32
Run Growth:
19
Growth Rate:
59.38%
Total runs:
32
Run Growth:
12
Growth Rate:
37.50%
Total runs:
32
Run Growth:
20
Growth Rate:
64.52%