CocoRoF / KoModernBERT-chp-01

huggingface.co
Total runs: 3
24-hour runs: 0
7-day runs: 0
30-day runs: 0
Model's Last Updated: January 23 2025
fill-mask

Introduction of KoModernBERT-chp-01

Model Details of KoModernBERT-chp-01

KoModernBERT

This model is a fine-tuned version of CocoRoF/KoModernBERT on the None dataset. It achieves the following results on the evaluation set:

  • Loss: 2.3473
Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure
Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 1e-05
  • train_batch_size: 8
  • eval_batch_size: 8
  • seed: 42
  • distributed_type: multi-GPU
  • num_devices: 8
  • gradient_accumulation_steps: 8
  • total_train_batch_size: 512
  • total_eval_batch_size: 64
  • optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
  • lr_scheduler_type: linear
  • lr_scheduler_warmup_ratio: 0.1
  • num_epochs: 1.0
Training results
Training Loss Epoch Step Validation Loss
26.6178 0.0928 5000 3.3099
23.887 0.1856 10000 2.9665
22.3186 0.2784 15000 2.7910
21.6275 0.3711 20000 2.6757
20.7564 0.4639 25000 2.5967
20.0201 0.5567 30000 2.5263
19.7037 0.6495 35000 2.4709
19.2119 0.7423 40000 2.4196
19.053 0.8351 45000 2.3825
18.7262 0.9279 50000 2.3473
Framework versions
  • Transformers 4.48.1
  • Pytorch 2.5.1+cu124
  • Datasets 3.2.0
  • Tokenizers 0.21.0

Runs of CocoRoF KoModernBERT-chp-01 on huggingface.co

3
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs

More Information About KoModernBERT-chp-01 huggingface.co Model

More KoModernBERT-chp-01 license Visit here:

https://choosealicense.com/licenses/apache-2.0

KoModernBERT-chp-01 huggingface.co

KoModernBERT-chp-01 huggingface.co is an AI model on huggingface.co that provides KoModernBERT-chp-01's model effect (), which can be used instantly with this CocoRoF KoModernBERT-chp-01 model. huggingface.co supports a free trial of the KoModernBERT-chp-01 model, and also provides paid use of the KoModernBERT-chp-01. Support call KoModernBERT-chp-01 model through api, including Node.js, Python, http.

KoModernBERT-chp-01 huggingface.co Url

https://huggingface.co/CocoRoF/KoModernBERT-chp-01

CocoRoF KoModernBERT-chp-01 online free

KoModernBERT-chp-01 huggingface.co is an online trial and call api platform, which integrates KoModernBERT-chp-01's modeling effects, including api services, and provides a free online trial of KoModernBERT-chp-01, you can try KoModernBERT-chp-01 online for free by clicking the link below.

CocoRoF KoModernBERT-chp-01 online free url in huggingface.co:

https://huggingface.co/CocoRoF/KoModernBERT-chp-01

KoModernBERT-chp-01 install

KoModernBERT-chp-01 is an open source model from GitHub that offers a free installation service, and any user can find KoModernBERT-chp-01 on GitHub to install. At the same time, huggingface.co provides the effect of KoModernBERT-chp-01 install, users can directly use KoModernBERT-chp-01 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

KoModernBERT-chp-01 install url in huggingface.co:

https://huggingface.co/CocoRoF/KoModernBERT-chp-01

Url of KoModernBERT-chp-01

KoModernBERT-chp-01 huggingface.co Url

Provider of KoModernBERT-chp-01 huggingface.co

CocoRoF
ORGANIZATIONS

Other API from CocoRoF

huggingface.co

Total runs: 12
Run Growth: -8
Growth Rate: -66.67%
Updated:February 18 2025
huggingface.co

Total runs: 5
Run Growth: -3
Growth Rate: -60.00%
Updated:March 21 2025
huggingface.co

Total runs: 4
Run Growth: 1
Growth Rate: 25.00%
Updated:February 02 2025