Total runs:
24.3K
Run Growth:
-27.9K
Growth Rate:
-114.28%
Sponsored by
PoYo.AI
pszemraj / bart-base-instructiongen-w-inputs
Model's Last Updated: December 29 2025
text-generation
Introduction of bart-base-instructiongen-w-inputs
Model Details of bart-base-instructiongen-w-inputs
bart-base-instructiongen-w-inputs
Use this text2text model to find out what LLM
instruction
(
and
inputs
if relevant) might have generated
<arbitrary input text>
!
- Check out a basic demo on Spaces
- An example of how to use instructiongen models in a CLI script can be found here
- You can find other models fine-tuned for instruction generation by searching for the instructiongen tag
about
This model is a fine-tuned version of
facebook/bart-base
on the
pszemraj/fleece2instructions-inputs-alpaca-cleaned
dataset.
It achieves the following results on the evaluation set:
- Loss: 0.9579
- Rouge1: 62.3604
- Rouge2: 39.5109
- Rougel: 58.8843
- Rougelsum: 60.4494
- Gen Len: 24.9917
Example
Intended uses & limitations
This model is intended to be used to generate instructions from arbitrary text. You can then use these instructions + your data to fine-tune an LLM on instructions w.r.t. a specific domain. This model is primarily intended to enable low-resource domain adaptation , rather than " I want to generate even better prompts for the FLAN-V2 dataset! ".
The
fleece2instructions-inputs-alpaca-cleaned
dataset, obtained from the
alpaca-lora repo
under the ODC-BY license, has been converted to a text2text format for use with language models. In this dataset, the original 'inputs' and 'instructions' columns are combined into a single 'instructions_inputs' column. To clearly separate the two types of content, each piece of text is prefixed with either an
<instruction>
or
<inputs>
token. These tokens not only facilitate model comprehension, but also allow for easy regex separation of model outputs during inference.
As such, users can expect the output of this model to be similarly structured with
<instruction>
and
<inputs>
tokens.
This is just the base model, for better performance (but slower/compute intensive) see the bart-large version. Further exploration/data may lead to even better models!
Training and evaluation data
Refer to the fleece2instructions-inputs-alpaca-cleaned dataset
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 8e-05
- train_batch_size: 4
- eval_batch_size: 4
- seed: 42
- distributed_type: multi-GPU
- gradient_accumulation_steps: 16
- total_train_batch_size: 64
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: cosine
- lr_scheduler_warmup_ratio: 0.02
- num_epochs: 2.0
Training results
| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
|---|---|---|---|---|---|---|---|---|
| 1.1147 | 1.0 | 680 | 0.9901 | 61.8451 | 38.8293 | 58.3372 | 59.8658 | 25.2401 |
| 0.9565 | 2.0 | 1360 | 0.9579 | 62.3604 | 39.5109 | 58.8843 | 60.4494 | 24.9917 |
Runs of pszemraj bart-base-instructiongen-w-inputs on huggingface.co
19
Total runs
0
24-hour runs
2
3-day runs
5
7-day runs
6
30-day runs
More Information About bart-base-instructiongen-w-inputs huggingface.co Model
Url of bart-base-instructiongen-w-inputs
bart-base-instructiongen-w-inputs huggingface.co Url
Provider of bart-base-instructiongen-w-inputs huggingface.co
Other API from pszemraj
Updated:December 29 2025
Total runs:
4.2K
Run Growth:
1.9K
Growth Rate:
45.04%
Total runs:
2.5K
Run Growth:
1000
Growth Rate:
41.32%
Total runs:
1.8K
Run Growth:
151
Growth Rate:
8.59%
Total runs:
902
Run Growth:
460
Growth Rate:
52.57%
Total runs:
697
Run Growth:
-206
Growth Rate:
-29.56%
Total runs:
670
Run Growth:
-230
Growth Rate:
-34.33%
Total runs:
669
Run Growth:
-205
Growth Rate:
-30.64%
Total runs:
665
Run Growth:
-233
Growth Rate:
-35.04%
Total runs:
648
Run Growth:
-266
Growth Rate:
-41.05%
Total runs:
333
Run Growth:
240
Growth Rate:
72.07%
Total runs:
324
Run Growth:
36
Growth Rate:
11.11%
Total runs:
237
Run Growth:
66
Growth Rate:
33.33%
Total runs:
231
Run Growth:
-257
Growth Rate:
-111.26%
Total runs:
148
Run Growth:
73
Growth Rate:
57.48%
Total runs:
126
Run Growth:
19
Growth Rate:
15.08%
Total runs:
114
Run Growth:
91
Growth Rate:
77.78%
Total runs:
91
Run Growth:
0
Growth Rate:
0.00%
Total runs:
86
Run Growth:
44
Growth Rate:
51.16%
Total runs:
84
Run Growth:
-23
Growth Rate:
-27.38%
Total runs:
81
Run Growth:
26
Growth Rate:
32.50%
Total runs:
74
Run Growth:
16
Growth Rate:
21.62%
Total runs:
73
Run Growth:
65
Growth Rate:
89.04%
Total runs:
71
Run Growth:
51
Growth Rate:
71.83%
Total runs:
70
Run Growth:
20
Growth Rate:
28.57%
Total runs:
62
Run Growth:
29
Growth Rate:
46.77%
Total runs:
52
Run Growth:
20
Growth Rate:
38.46%
Total runs:
50
Run Growth:
40
Growth Rate:
80.00%
Total runs:
48
Run Growth:
29
Growth Rate:
60.42%
Total runs:
46
Run Growth:
18
Growth Rate:
41.86%
Total runs:
44
Run Growth:
32
Growth Rate:
72.73%
Total runs:
44
Run Growth:
-9
Growth Rate:
-21.43%
Total runs:
42
Run Growth:
17
Growth Rate:
48.57%
Total runs:
40
Run Growth:
31
Growth Rate:
77.50%
Total runs:
36
Run Growth:
15
Growth Rate:
41.67%
Total runs:
36
Run Growth:
11
Growth Rate:
31.43%
Total runs:
36
Run Growth:
-6
Growth Rate:
-16.67%
Total runs:
34
Run Growth:
14
Growth Rate:
41.18%
Total runs:
33
Run Growth:
22
Growth Rate:
66.67%
Total runs:
33
Run Growth:
31
Growth Rate:
93.94%
Total runs:
31
Run Growth:
24
Growth Rate:
77.42%
Total runs:
29
Run Growth:
15
Growth Rate:
62.50%
Total runs:
28
Run Growth:
28
Growth Rate:
100.00%
Total runs:
28
Run Growth:
15
Growth Rate:
53.57%
Total runs:
28
Run Growth:
-35
Growth Rate:
-318.18%
Total runs:
28
Run Growth:
15
Growth Rate:
71.43%
Total runs:
27
Run Growth:
-5
Growth Rate:
-18.52%
Total runs:
27
Run Growth:
-147
Growth Rate:
-544.44%
Total runs:
26
Run Growth:
10
Growth Rate:
43.48%
Total runs:
25
Run Growth:
5
Growth Rate:
20.00%
Total runs:
25
Run Growth:
18
Growth Rate:
72.00%
Total runs:
23
Run Growth:
13
Growth Rate:
54.17%
Total runs:
23
Run Growth:
11
Growth Rate:
47.83%
Total runs:
22
Run Growth:
15
Growth Rate:
71.43%
Total runs:
22
Run Growth:
16
Growth Rate:
72.73%
Total runs:
22
Run Growth:
4
Growth Rate:
18.18%
Total runs:
22
Run Growth:
3
Growth Rate:
13.64%
Total runs:
21
Run Growth:
11
Growth Rate:
52.38%
Total runs:
21
Run Growth:
12
Growth Rate:
57.14%
Total runs:
21
Run Growth:
12
Growth Rate:
60.00%
Total runs:
21
Run Growth:
10
Growth Rate:
52.63%
Total runs:
21
Run Growth:
12
Growth Rate:
57.14%
Total runs:
21
Run Growth:
11
Growth Rate:
52.38%
Total runs:
20
Run Growth:
8
Growth Rate:
42.11%
Total runs:
20
Run Growth:
13
Growth Rate:
65.00%
Total runs:
20
Run Growth:
7
Growth Rate:
36.84%
Total runs:
20
Run Growth:
12
Growth Rate:
54.55%
Total runs:
20
Run Growth:
10
Growth Rate:
50.00%
Total runs:
20
Run Growth:
11
Growth Rate:
55.00%
Total runs:
19
Run Growth:
12
Growth Rate:
63.16%
Total runs:
19
Run Growth:
8
Growth Rate:
42.11%
Total runs:
19
Run Growth:
5
Growth Rate:
26.32%
Total runs:
19
Run Growth:
9
Growth Rate:
47.37%
Total runs:
18
Run Growth:
6
Growth Rate:
35.29%
Total runs:
17
Run Growth:
6
Growth Rate:
35.29%
Total runs:
17
Run Growth:
3
Growth Rate:
17.65%
Total runs:
17
Run Growth:
5
Growth Rate:
29.41%
Total runs:
17
Run Growth:
6
Growth Rate:
35.29%
Total runs:
17
Run Growth:
4
Growth Rate:
23.53%
Total runs:
17
Run Growth:
10
Growth Rate:
58.82%
Total runs:
16
Run Growth:
11
Growth Rate:
73.33%
Total runs:
16
Run Growth:
5
Growth Rate:
31.25%
Total runs:
16
Run Growth:
9
Growth Rate:
56.25%
Total runs:
15
Run Growth:
11
Growth Rate:
73.33%
Total runs:
15
Run Growth:
7
Growth Rate:
50.00%
Total runs:
15
Run Growth:
9
Growth Rate:
60.00%
Total runs:
15
Run Growth:
-5
Growth Rate:
-33.33%
Total runs:
15
Run Growth:
10
Growth Rate:
66.67%
Total runs:
14
Run Growth:
6
Growth Rate:
42.86%
Total runs:
14
Run Growth:
9
Growth Rate:
64.29%
Total runs:
14
Run Growth:
-24
Growth Rate:
-171.43%
Total runs:
14
Run Growth:
10
Growth Rate:
71.43%
Total runs:
14
Run Growth:
9
Growth Rate:
64.29%