SweepBestModel is a RoBERTa-base model fine-tuned for sequence classification through a systematic hyperparameter sweep. We explored learning rates and weight decay values to find the optimal configuration.
Training Configuration
Run
Learning Rate
Weight Decay
Best Checkpoint
Best F1
run_lr2e-5_wd0.01
2e-5
0.01
\u2014
{RESULT}
run_lr5e-5_wd0.01
5e-5
0.01
\u2014
{RESULT}
run_lr1e-4_wd0.01
1e-4
0.01
\u2014
{RESULT}
run_lr2e-5_wd0.1
2e-5
0.1
\u2014
{RESULT}
Sweep Results
Run
Learning Rate
Weight Decay
Best Eval F1
run_lr2e-5_wd0.01
2e-5
0.01
0.827
run_lr5e-5_wd0.01
5e-5
0.01
0.856
run_lr1e-4_wd0.01
1e-4
0.01
0.793
run_lr2e-5_wd0.1
2e-5
0.1
0.741
The best performing configuration used a learning rate of 5e-5 with weight decay 0.01, achieving the highest F1 score across all sweep runs.
Usage
from transformers import AutoModelForSequenceClassification, AutoTokenizer
model = AutoModelForSequenceClassification.from_pretrained("SweepBest-TestRepo")
tokenizer = AutoTokenizer.from_pretrained("SweepBest-TestRepo")
License
This model is released under the Apache 2.0 license.
Runs of dusersad12 SweepBest-TestRepo on huggingface.co
8
Total runs
0
24-hour runs
1
3-day runs
-1
7-day runs
-31
30-day runs
More Information About SweepBest-TestRepo huggingface.co Model
SweepBest-TestRepo huggingface.co is an AI model on huggingface.co that provides SweepBest-TestRepo's model effect (), which can be used instantly with this dusersad12 SweepBest-TestRepo model. huggingface.co supports a free trial of the SweepBest-TestRepo model, and also provides paid use of the SweepBest-TestRepo. Support call SweepBest-TestRepo model through api, including Node.js, Python, http.
SweepBest-TestRepo huggingface.co is an online trial and call api platform, which integrates SweepBest-TestRepo's modeling effects, including api services, and provides a free online trial of SweepBest-TestRepo, you can try SweepBest-TestRepo online for free by clicking the link below.
dusersad12 SweepBest-TestRepo online free url in huggingface.co:
SweepBest-TestRepo is an open source model from GitHub that offers a free installation service, and any user can find SweepBest-TestRepo on GitHub to install. At the same time, huggingface.co provides the effect of SweepBest-TestRepo install, users can directly use SweepBest-TestRepo installed effect in huggingface.co for debugging and trial. It also supports api for free installation.