DerivedFunction / distilbert-finance-sec

huggingface.co
Total runs: 8
24-hour runs: 0
7-day runs: -15
30-day runs: -8
Model's Last Updated: March 16 2026
fill-mask

Introduction of distilbert-finance-sec

Model Details of distilbert-finance-sec

distilbert-dapt

This model is a fine-tuned version of distilbert/distilbert-base-uncased on a dataset. It achieves the following results on the evaluation set:

  • Loss: 1.3623
Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure
Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 5e-05
  • train_batch_size: 32
  • eval_batch_size: 64
  • seed: 42
  • optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
  • lr_scheduler_type: linear
  • lr_scheduler_warmup_steps: 0.1
  • num_epochs: 1
  • mixed_precision_training: Native AMP
Training results
Training Loss Epoch Step Validation Loss
1.8489 0.1195 500 1.7333
1.6703 0.2390 1000 1.5837
1.5914 0.3585 1500 1.5023
1.5805 0.4780 2000 1.4578
1.5379 0.5975 2500 1.4236
1.4827 0.7170 3000 1.4011
1.4549 0.8365 3500 1.3739
1.4450 0.9560 4000 1.3623
Framework versions
  • Transformers 5.2.0
  • Pytorch 2.10.0+cu128
  • Datasets 4.3.0
  • Tokenizers 0.22.2

Runs of DerivedFunction distilbert-finance-sec on huggingface.co

8
Total runs
0
24-hour runs
1
3-day runs
-15
7-day runs
-8
30-day runs

More Information About distilbert-finance-sec huggingface.co Model

More distilbert-finance-sec license Visit here:

https://choosealicense.com/licenses/apache-2.0

distilbert-finance-sec huggingface.co

distilbert-finance-sec huggingface.co is an AI model on huggingface.co that provides distilbert-finance-sec's model effect (), which can be used instantly with this DerivedFunction distilbert-finance-sec model. huggingface.co supports a free trial of the distilbert-finance-sec model, and also provides paid use of the distilbert-finance-sec. Support call distilbert-finance-sec model through api, including Node.js, Python, http.

DerivedFunction distilbert-finance-sec online free

distilbert-finance-sec huggingface.co is an online trial and call api platform, which integrates distilbert-finance-sec's modeling effects, including api services, and provides a free online trial of distilbert-finance-sec, you can try distilbert-finance-sec online for free by clicking the link below.

DerivedFunction distilbert-finance-sec online free url in huggingface.co:

https://huggingface.co/DerivedFunction/distilbert-finance-sec

distilbert-finance-sec install

distilbert-finance-sec is an open source model from GitHub that offers a free installation service, and any user can find distilbert-finance-sec on GitHub to install. At the same time, huggingface.co provides the effect of distilbert-finance-sec install, users can directly use distilbert-finance-sec installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

distilbert-finance-sec install url in huggingface.co:

https://huggingface.co/DerivedFunction/distilbert-finance-sec

Url of distilbert-finance-sec

distilbert-finance-sec huggingface.co Url

Provider of distilbert-finance-sec huggingface.co

DerivedFunction
ORGANIZATIONS

Other API from DerivedFunction