Total runs:
1.2K
Run Growth:
106
Growth Rate:
8.49%
Sponsored by
Agentkit
qingy2024 / Formatter-0.6B
Model's Last Updated: May 18 2025
text-generation
Introduction of Formatter-0.6B
Model Details of Formatter-0.6B
Formatter 0.6B
- Developed by: qingy2024
- License: apache-2.0
- Finetuned from model : Qwen3 0.6B (base)
This is mainly my experiment to play around with adding special tokens and changing the chat template while fine-tuning.
{%- set last_message = messages[-1] -%}
{%- if last_message.role == "user" -%}
{{- '<|problem_start|>\n' + last_message.content + '<|problem_end|>\n' -}}
{%- elif last_message.role == "assistant" -%}
{%- for message in messages -%}
{%- if message.role == "user" -%}
{{- '<|problem_start|>\n' + message.content + '<|problem_end|>\n' -}}
{%- elif message.role == "assistant" -%}
{{- '<|formatted_problem_start|>\n' + message.content + '<|formatted_problem_end|>\n' -}}
{%- else -%}
{{- raise('Unknown role: ' + message.role) -}}
{%- endif -%}
{%- endfor -%}
{%- else -%}
{{- raise('Unsupported role: ' + last_message.role) -}}
{%- endif -%}
{%- if add_generation_prompt and last_message.role == "user" -%}
{{- '<|formatted_problem_start|>\n' -}}
{%- endif -%}
Example:
User: Read the excerpt from Dr. Martin Luther King Jr.’s "I Have a Dream" speech.
I am not unmindful that some of you have come here out of great trials and tribulations. Some of you have come fresh from narrow jail cells. Some of you have come from areas where your quest for freedom left you battered by the storms of persecution and staggered by the winds of police brutality. You have been the veterans of creative suffering. Continue to work with the faith that unearned suffering is redemptive. Go back to Mississippi, go back to Alabama, go back to South Carolina, go back to Georgia, go back to Louisiana, go back to the slums and ghettos of our northern cities, knowing that somehow this situation can and will be changed. Let us not wallow in the valley of despair.
Which lines in this paragraph can be used as examples of metaphor? Select 3 options.
great trials and tribulations
storms of persecution
winds of police brutality
go back to Georgia
this situation can and will be changed
let us not wallow in the valley of despair
LLM: Read the excerpt from Dr. Martin Luther King Jr.’s "I Have a Dream" speech.
I am not unmindful that some of you have come here out of great trials and tribulations. Some of you have come fresh from narrow jail cells. Some of you have come from areas where your quest for freedom left you battered by the storms of persecution and staggered by the winds of police brutality. You have been the veterans of creative suffering. Continue to work with the faith that unearned suffering is redemptive. Go back to Mississippi, go back to Alabama, go back to South Carolina, go back to Georgia, go back to Louisiana, go back to the slums and ghettos of our northern cities, knowing that somehow this situation can and will be changed. Let us not wallow in the valley of despair.
Which lines in this paragraph can be used as examples of metaphor? Select 3 options.
A. great trials and tribulations
B. storms of persecution
C. winds of police brutality
D. go back to Georgia
E. this situation can and will be changed
F. let us not wallow in the valley of despair
Lessons Learned
- When adding new tokens to the model, LoRA will be much worse. Use full fine-tuning to get better results.
- Be very careful about chat templates. Every character/new line/space matters and not following that can make the model have worse performance.
-
For Qwen base models, leave the
<|endoftext|>as the EOS token. Then you can train it to use other tokens like<|im_end|>. If you set the EOS token to<|im_end|>, the model will get confused. -
For Qwen models in general, always put the
<|endoftext|>at the end of each training example.
Runs of qingy2024 Formatter-0.6B on huggingface.co
15
Total runs
0
24-hour runs
0
3-day runs
-3
7-day runs
-118
30-day runs
More Information About Formatter-0.6B huggingface.co Model
Url of Formatter-0.6B
Formatter-0.6B huggingface.co Url
Provider of Formatter-0.6B huggingface.co
Other API from qingy2024
Updated:November 22 2024
Total runs:
601
Run Growth:
0
Growth Rate:
0.00%
Total runs:
348
Run Growth:
188
Growth Rate:
59.87%
Total runs:
226
Run Growth:
-58
Growth Rate:
-27.75%
Total runs:
147
Run Growth:
0
Growth Rate:
0.00%
Total runs:
128
Run Growth:
39
Growth Rate:
33.05%
Total runs:
118
Run Growth:
-43
Growth Rate:
-39.09%
Total runs:
116
Run Growth:
111
Growth Rate:
95.69%
Total runs:
107
Run Growth:
0
Growth Rate:
0.00%
Total runs:
105
Run Growth:
-55
Growth Rate:
-52.38%
Total runs:
78
Run Growth:
42
Growth Rate:
53.85%
Total runs:
63
Run Growth:
0
Growth Rate:
0.00%
Total runs:
58
Run Growth:
9
Growth Rate:
15.52%
Total runs:
51
Run Growth:
-20
Growth Rate:
-43.48%
Total runs:
46
Run Growth:
0
Growth Rate:
0.00%
Total runs:
30
Run Growth:
0
Growth Rate:
0.00%
Total runs:
29
Run Growth:
-2
Growth Rate:
-8.00%
Total runs:
27
Run Growth:
11
Growth Rate:
44.00%
Total runs:
26
Run Growth:
13
Growth Rate:
50.00%
Total runs:
25
Run Growth:
20
Growth Rate:
80.00%
Total runs:
25
Run Growth:
6
Growth Rate:
25.00%
Total runs:
23
Run Growth:
0
Growth Rate:
0.00%
Total runs:
20
Run Growth:
-6
Growth Rate:
-30.00%
Total runs:
20
Run Growth:
14
Growth Rate:
70.00%
Total runs:
19
Run Growth:
0
Growth Rate:
0.00%
Total runs:
18
Run Growth:
-6
Growth Rate:
-33.33%
Total runs:
17
Run Growth:
-2
Growth Rate:
-11.76%
Total runs:
17
Run Growth:
6
Growth Rate:
35.29%
Total runs:
15
Run Growth:
-13
Growth Rate:
-86.67%
Total runs:
15
Run Growth:
2
Growth Rate:
13.33%
Total runs:
13
Run Growth:
-7
Growth Rate:
-58.33%
Total runs:
13
Run Growth:
-14
Growth Rate:
-127.27%
Total runs:
13
Run Growth:
-30
Growth Rate:
-272.73%
Total runs:
11
Run Growth:
-8
Growth Rate:
-80.00%
Total runs:
11
Run Growth:
11
Growth Rate:
100.00%
Total runs:
11
Run Growth:
4
Growth Rate:
36.36%
Total runs:
11
Run Growth:
1
Growth Rate:
9.09%
Total runs:
10
Run Growth:
1
Growth Rate:
11.11%
Total runs:
10
Run Growth:
-2
Growth Rate:
-22.22%
Total runs:
10
Run Growth:
-10
Growth Rate:
-111.11%
Total runs:
9
Run Growth:
0
Growth Rate:
0.00%
Total runs:
9
Run Growth:
-13
Growth Rate:
-162.50%
Total runs:
9
Run Growth:
1
Growth Rate:
11.11%
Total runs:
8
Run Growth:
3
Growth Rate:
37.50%
Total runs:
8
Run Growth:
4
Growth Rate:
50.00%
Total runs:
8
Run Growth:
-1
Growth Rate:
-12.50%
Total runs:
8
Run Growth:
-51
Growth Rate:
-637.50%
Total runs:
7
Run Growth:
4
Growth Rate:
57.14%
Total runs:
7
Run Growth:
-3
Growth Rate:
-42.86%
Total runs:
7
Run Growth:
7
Growth Rate:
100.00%
Total runs:
6
Run Growth:
3
Growth Rate:
50.00%
Total runs:
6
Run Growth:
-115
Growth Rate:
-1916.67%
Total runs:
6
Run Growth:
0
Growth Rate:
0.00%
Total runs:
6
Run Growth:
3
Growth Rate:
50.00%
Total runs:
6
Run Growth:
0
Growth Rate:
0.00%
Total runs:
6
Run Growth:
-5
Growth Rate:
-100.00%
Total runs:
6
Run Growth:
5
Growth Rate:
83.33%
Total runs:
6
Run Growth:
4
Growth Rate:
66.67%
Total runs:
6
Run Growth:
3
Growth Rate:
50.00%
Total runs:
5
Run Growth:
2
Growth Rate:
40.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
-29
Growth Rate:
-580.00%
Total runs:
5
Run Growth:
-9
Growth Rate:
-180.00%
Total runs:
5
Run Growth:
-1
Growth Rate:
-20.00%
Total runs:
5
Run Growth:
-3
Growth Rate:
-75.00%
Total runs:
4
Run Growth:
0
Growth Rate:
0.00%