valurank / distilroberta-current

huggingface.co
Total runs: 42
24-hour runs: 4
7-day runs: 3
30-day runs: 35
Model's Last Updated: June 09 2022
text-classification

Introduction of distilroberta-current

Model Details of distilroberta-current

distilroberta-current

This model classifies articles as current (covering or discussing current events) or not current (not relating to current events).

The model is a fine-tuned version of distilroberta-base on a dataset of articles labeled using weak-supervision and manual labeling

It achieves the following results on the evaluation set:

  • Loss: 0.1745
  • Acc: 0.9355
Training procedure
Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 2e-05
  • train_batch_size: 8
  • eval_batch_size: 8
  • seed: 12345
  • gradient_accumulation_steps: 4
  • total_train_batch_size: 32
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • lr_scheduler_warmup_steps: 16
  • num_epochs: 20
  • mixed_precision_training: Native AMP
Training results
Training Loss Epoch Step Validation Loss Acc
No log 1.0 11 0.6559 0.7097
0.6762 2.0 22 0.5627 0.7097
0.5432 3.0 33 0.4606 0.7097
0.5432 4.0 44 0.3651 0.8065
0.411 5.0 55 0.2512 0.9194
0.269 6.0 66 0.2774 0.9355
0.269 7.0 77 0.2062 0.8710
0.2294 8.0 88 0.2598 0.9355
0.1761 9.0 99 0.1745 0.9355
Framework versions
  • Transformers 4.11.3
  • Pytorch 1.10.1
  • Datasets 1.17.0
  • Tokenizers 0.10.3

Runs of valurank distilroberta-current on huggingface.co

42
Total runs
4
24-hour runs
2
3-day runs
3
7-day runs
35
30-day runs

More Information About distilroberta-current huggingface.co Model

More distilroberta-current license Visit here:

https://choosealicense.com/licenses/other

distilroberta-current huggingface.co

distilroberta-current huggingface.co is an AI model on huggingface.co that provides distilroberta-current's model effect (), which can be used instantly with this valurank distilroberta-current model. huggingface.co supports a free trial of the distilroberta-current model, and also provides paid use of the distilroberta-current. Support call distilroberta-current model through api, including Node.js, Python, http.

distilroberta-current huggingface.co Url

https://huggingface.co/valurank/distilroberta-current

valurank distilroberta-current online free

distilroberta-current huggingface.co is an online trial and call api platform, which integrates distilroberta-current's modeling effects, including api services, and provides a free online trial of distilroberta-current, you can try distilroberta-current online for free by clicking the link below.

valurank distilroberta-current online free url in huggingface.co:

https://huggingface.co/valurank/distilroberta-current

distilroberta-current install

distilroberta-current is an open source model from GitHub that offers a free installation service, and any user can find distilroberta-current on GitHub to install. At the same time, huggingface.co provides the effect of distilroberta-current install, users can directly use distilroberta-current installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

distilroberta-current install url in huggingface.co:

https://huggingface.co/valurank/distilroberta-current

Url of distilroberta-current

distilroberta-current huggingface.co Url

Provider of distilroberta-current huggingface.co

valurank
ORGANIZATIONS

Other API from valurank