UMCU / CardioBERTa.nl_base

huggingface.co
Total runs: 54
24-hour runs: 0
7-day runs: 0
30-day runs: 0
Model's Last Updated: June 21 2025
fill-mask

Introduction of CardioBERTa.nl_base

Model Details of CardioBERTa.nl_base

Continued, off-premise, pre-training of MedRoBERTa.nl using about 50GB of open Dutch and translated English corpora.

Data statistics

Sources:

  • Dutch: medical guidelines (FMS, NHG)
  • Dutch: NtvG papers
  • English: Pubmed abstracts
  • English: PMC abstracts translated using DeepL
  • English: Apollo guidelines, papers and books
  • English: Meditron guidelines
  • English: MIMIC3
  • English: MIMIC CXR
  • English: MIMIC4

All translated (if not with DeepL) with a combination of GeminiFlash 1.5/GPT4o mini, MariaNMT, NLLB200.

  • Number of tokens: 15B
  • Number of documents: 27M

Training

  • Effective batch size: 5120
  • Learning rate: 2e-4
  • Weight decay: 1e-3
  • Learning schedule: linear, with 5_000 warmup steps
  • Num epochs: ~3

Train perplexity: 3.0 Validation perplexity: 3.0

Acknowledgement

This work was done together with the Amsterdam UMC, in the context of the DataTools4Heart project.

We were happy to be able to use the Google TPU research cloud for training the model.

Runs of UMCU CardioBERTa.nl_base on huggingface.co

54
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs

More Information About CardioBERTa.nl_base huggingface.co Model

More CardioBERTa.nl_base license Visit here:

https://choosealicense.com/licenses/gpl-3.0

CardioBERTa.nl_base huggingface.co

CardioBERTa.nl_base huggingface.co is an AI model on huggingface.co that provides CardioBERTa.nl_base's model effect (), which can be used instantly with this UMCU CardioBERTa.nl_base model. huggingface.co supports a free trial of the CardioBERTa.nl_base model, and also provides paid use of the CardioBERTa.nl_base. Support call CardioBERTa.nl_base model through api, including Node.js, Python, http.

CardioBERTa.nl_base huggingface.co Url

https://huggingface.co/UMCU/CardioBERTa.nl_base

UMCU CardioBERTa.nl_base online free

CardioBERTa.nl_base huggingface.co is an online trial and call api platform, which integrates CardioBERTa.nl_base's modeling effects, including api services, and provides a free online trial of CardioBERTa.nl_base, you can try CardioBERTa.nl_base online for free by clicking the link below.

UMCU CardioBERTa.nl_base online free url in huggingface.co:

https://huggingface.co/UMCU/CardioBERTa.nl_base

CardioBERTa.nl_base install

CardioBERTa.nl_base is an open source model from GitHub that offers a free installation service, and any user can find CardioBERTa.nl_base on GitHub to install. At the same time, huggingface.co provides the effect of CardioBERTa.nl_base install, users can directly use CardioBERTa.nl_base installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

CardioBERTa.nl_base install url in huggingface.co:

https://huggingface.co/UMCU/CardioBERTa.nl_base

Url of CardioBERTa.nl_base

CardioBERTa.nl_base huggingface.co Url

Provider of CardioBERTa.nl_base huggingface.co

UMCU
ORGANIZATIONS

Other API from UMCU

huggingface.co

Total runs: 4
Run Growth: 0
Growth Rate: 0.00%
Updated:October 03 2025