This model is a fine-tuned version of
facebook/bart-large
on the
pszemraj/fleece2instructions-codealpaca
dataset.
It achieves the following results on the evaluation set:
Loss: 0.9222
Rouge1: 62.0692
Rouge2: 36.1947
Rougel: 57.5128
Rougelsum: 58.6613
Gen Len: 31.0060
Intended uses & limitations
🚨
note:
as the authors elected to release the
original dataset
under
cc-by-nc
, the license carries over to this model and
cannot be used for commercial activity
.
Intended use: Research on domain adaptation and/or other improvements to LLMs by extending instruction:text data pairs.
Training and evaluation data
Refer to the linked dataset card for
pszemraj/fleece2instructions-codealpaca
or the
original dataset
repo.
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
learning_rate: 6e-05
train_batch_size: 16
eval_batch_size: 8
seed: 42
distributed_type: multi-GPU
gradient_accumulation_steps: 2
total_train_batch_size: 32
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: cosine
lr_scheduler_warmup_ratio: 0.03
num_epochs: 3.0
Training results
Training Loss
Epoch
Step
Validation Loss
Rouge1
Rouge2
Rougel
Rougelsum
Gen Len
1.0914
1.0
563
1.0303
60.288
34.1884
55.9293
57.0714
30.6267
0.8688
2.0
1126
0.9333
61.0409
34.9823
56.4887
57.6662
31.7255
0.6773
3.0
1689
0.9222
62.0692
36.1947
57.5128
58.6613
31.0060
Runs of pszemraj bart-large-code-instructiongen on huggingface.co
19
Total runs
0
24-hour runs
1
3-day runs
-3
7-day runs
2
30-day runs
More Information About bart-large-code-instructiongen huggingface.co Model
More bart-large-code-instructiongen license Visit here:
bart-large-code-instructiongen huggingface.co is an AI model on huggingface.co that provides bart-large-code-instructiongen's model effect (), which can be used instantly with this pszemraj bart-large-code-instructiongen model. huggingface.co supports a free trial of the bart-large-code-instructiongen model, and also provides paid use of the bart-large-code-instructiongen. Support call bart-large-code-instructiongen model through api, including Node.js, Python, http.
bart-large-code-instructiongen huggingface.co is an online trial and call api platform, which integrates bart-large-code-instructiongen's modeling effects, including api services, and provides a free online trial of bart-large-code-instructiongen, you can try bart-large-code-instructiongen online for free by clicking the link below.
pszemraj bart-large-code-instructiongen online free url in huggingface.co:
bart-large-code-instructiongen is an open source model from GitHub that offers a free installation service, and any user can find bart-large-code-instructiongen on GitHub to install. At the same time, huggingface.co provides the effect of bart-large-code-instructiongen install, users can directly use bart-large-code-instructiongen installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
bart-large-code-instructiongen install url in huggingface.co: