muhtasham / bert-small-eurlex

huggingface.co
Total runs: 12
24-hour runs: 0
7-day runs: 4
30-day runs: -25
Model's Last Updated: August 29 2022

Introduction of bert-small-eurlex

Model Details of bert-small-eurlex

bert-small-eurlex

This model is a fine-tuned version of google/bert_uncased_L-4_H-512_A-8 on the eurlex dataset. It achieves the following results on the evaluation set:

  • Loss: 1.4260
Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure
Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 5e-05
  • train_batch_size: 10
  • eval_batch_size: 64
  • seed: 42
  • gradient_accumulation_steps: 8
  • total_train_batch_size: 80
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 10
Training results
Training Loss Epoch Step Validation Loss
2.9536 1.5 1000 2.0670
2.0331 3.0 2000 1.7540
1.8046 4.5 3000 1.5993
1.678 6.0 4000 1.5039
1.6074 7.5 5000 1.4544
1.5664 8.99 6000 1.4260
Framework versions
  • Transformers 4.18.0
  • Pytorch 1.12.1+cu113
  • Datasets 2.4.0
  • Tokenizers 0.12.1

Runs of muhtasham bert-small-eurlex on huggingface.co

12
Total runs
0
24-hour runs
4
3-day runs
4
7-day runs
-25
30-day runs

More Information About bert-small-eurlex huggingface.co Model

More bert-small-eurlex license Visit here:

https://choosealicense.com/licenses/apache-2.0

bert-small-eurlex huggingface.co

bert-small-eurlex huggingface.co is an AI model on huggingface.co that provides bert-small-eurlex's model effect (), which can be used instantly with this muhtasham bert-small-eurlex model. huggingface.co supports a free trial of the bert-small-eurlex model, and also provides paid use of the bert-small-eurlex. Support call bert-small-eurlex model through api, including Node.js, Python, http.

bert-small-eurlex huggingface.co Url

https://huggingface.co/muhtasham/bert-small-eurlex

muhtasham bert-small-eurlex online free

bert-small-eurlex huggingface.co is an online trial and call api platform, which integrates bert-small-eurlex's modeling effects, including api services, and provides a free online trial of bert-small-eurlex, you can try bert-small-eurlex online for free by clicking the link below.

muhtasham bert-small-eurlex online free url in huggingface.co:

https://huggingface.co/muhtasham/bert-small-eurlex

bert-small-eurlex install

bert-small-eurlex is an open source model from GitHub that offers a free installation service, and any user can find bert-small-eurlex on GitHub to install. At the same time, huggingface.co provides the effect of bert-small-eurlex install, users can directly use bert-small-eurlex installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

bert-small-eurlex install url in huggingface.co:

https://huggingface.co/muhtasham/bert-small-eurlex

Url of bert-small-eurlex

bert-small-eurlex huggingface.co Url

Provider of bert-small-eurlex huggingface.co

muhtasham
ORGANIZATIONS

Other API from muhtasham