UMCU / CardioBERTa_base.nl

huggingface.co
Total runs: 18
24-hour runs: 0
7-day runs: 2
30-day runs: 6
Model's Last Updated: 6月 21 2025
fill-mask

Introduction of CardioBERTa_base.nl

Model Details of CardioBERTa_base.nl

Continued, off-premise, pre-training of MedRoBERTa.nl using about 50GB of open Dutch and translated English corpora.

Data statistics

Sources:

  • Dutch: medical guidelines (FMS, NHG)
  • Dutch: NtvG papers
  • English: Pubmed abstracts
  • English: PMC abstracts translated using DeepL
  • English: Apollo guidelines, papers and books
  • English: Meditron guidelines
  • English: MIMIC3
  • English: MIMIC CXR
  • English: MIMIC4

All translated (if not with DeepL) with a combination of GeminiFlash 1.5/GPT4o mini, MariaNMT, NLLB200.

  • Number of tokens: 15B
  • Number of documents: 27M

Training

  • Effective batch size: 5120
  • Learning rate: 2e-4
  • Weight decay: 1e-3
  • Learning schedule: linear, with 5_000 warmup steps
  • Num epochs: ~3

Train perplexity: 3.0 Validation perplexity: 3.0

Acknowledgement

This work was done together with the Amsterdam UMC, in the context of the DataTools4Heart project.

We were happy to be able to use the Google TPU research cloud for training the model.

Runs of UMCU CardioBERTa_base.nl on huggingface.co

18
Total runs
0
24-hour runs
2
3-day runs
2
7-day runs
6
30-day runs

More Information About CardioBERTa_base.nl huggingface.co Model

More CardioBERTa_base.nl license Visit here:

https://choosealicense.com/licenses/gpl-3.0

CardioBERTa_base.nl huggingface.co

CardioBERTa_base.nl huggingface.co is an AI model on huggingface.co that provides CardioBERTa_base.nl's model effect (), which can be used instantly with this UMCU CardioBERTa_base.nl model. huggingface.co supports a free trial of the CardioBERTa_base.nl model, and also provides paid use of the CardioBERTa_base.nl. Support call CardioBERTa_base.nl model through api, including Node.js, Python, http.

CardioBERTa_base.nl huggingface.co Url

https://huggingface.co/UMCU/CardioBERTa_base.nl

UMCU CardioBERTa_base.nl online free

CardioBERTa_base.nl huggingface.co is an online trial and call api platform, which integrates CardioBERTa_base.nl's modeling effects, including api services, and provides a free online trial of CardioBERTa_base.nl, you can try CardioBERTa_base.nl online for free by clicking the link below.

UMCU CardioBERTa_base.nl online free url in huggingface.co:

https://huggingface.co/UMCU/CardioBERTa_base.nl

CardioBERTa_base.nl install

CardioBERTa_base.nl is an open source model from GitHub that offers a free installation service, and any user can find CardioBERTa_base.nl on GitHub to install. At the same time, huggingface.co provides the effect of CardioBERTa_base.nl install, users can directly use CardioBERTa_base.nl installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

CardioBERTa_base.nl install url in huggingface.co:

https://huggingface.co/UMCU/CardioBERTa_base.nl

Url of CardioBERTa_base.nl

CardioBERTa_base.nl huggingface.co Url

Provider of CardioBERTa_base.nl huggingface.co

UMCU
ORGANIZATIONS

Other API from UMCU

huggingface.co

Total runs: 4
Run Growth: 0
Growth Rate: 0.00%
Updated:10月 03 2025