Total runs:
451
Run Growth:
433
Growth Rate:
100.00%
Sponsored by
APIMart
MIC-DKFZ / nnFoundationViT
Model's Last Updated: October 08 2026
Introduction of nnFoundationViT
Model Details of nnFoundationViT
nnFoundationViT
Copyright German Cancer Research Center (DKFZ) and contributors. Please make sure that your usage of these models is in compliance with their license.
nnFoundationViT
is one of the two
nnFoundation
3D radiology foundation models, pre-trained
with the
nnssl
self-supervised learning framework.
Model pair
| Model | Architecture | Details | Params | Repository |
|---|---|---|---|---|
| nnFoundationViT | ResEnc | 6 stages, features 32–64–128–256–320–320 | 102M | MIC-DKFZ/nnFoundationCNN |
| nnFoundationViT | Primus | 40 layers, embedding dim 1056, 16 heads, 8³ patch tokens | 674M | this repository |
Using nnFoundation
To fine-tune nnFoundation on your own downstream tasks, use one of our dedicated repositories:
- Segmentation: nnU-Net -- Fine-tuning from nnssl checkpoints
- Detection: TBA
- Classification: TBA
- Report generation: TBA
Planning and preprocessing straight from this repository
nnU-Net
can pull these weights itself — pass the repository URL where a checkpoint path is
expected. Set
nnssl_pretrained_models
first; that is where the download is cached.
export nnssl_pretrained_models=/path/to/pretrained_models
nnUNetv2_preprocess_like_nnssl \
-d <DATASET_ID> \
-n <UniquePretrainingName> \
-pc https://huggingface.co/MIC-DKFZ/nnFoundationViT \
-am like_pretrained
Or download the file yourself and pass a local path:
from huggingface_hub import hf_hub_download
ckpt = hf_hub_download("MIC-DKFZ/nnFoundationViT", "checkpoint_final.pth")
Repository contents
| File | Purpose |
|---|---|
checkpoint_final.pth
|
the pre-trained weights (674M parameters) |
adaptation_plan.json
|
architecture + preprocessing plan; nnU-Net reads this to confirm compatibility |
config.json
|
placeholder so the Hub records download counts |
Expected input
Single-channel 3D volumes, Z-score normalised , with no resampling . Recommended downstream patch size: 192 × 192 × 192 .
Checkpoint format
checkpoint_final.pth
is a
torch.save
dictionary that loads safely with
weights_only=True
:
| Key | Contents |
|---|---|
network_weights
|
the pre-trained
state_dict
|
nnssl_adaptation_plan
|
same content as
adaptation_plan.json
|
citations
|
the reference(s) to cite when using these weights |
Citation
If you use the
nnFoundation
models or the
nnssl
framework, please cite:
nnFoundation BibTeX
@misc{harsy2026nnfoundation3dfoundationmodels,
title={nnFoundation: 3D Foundation Models for Radiology},
author={Constantin Ulrich Harsy and Tassilo Wald and Karol Gotkowski and Yannick Kirchhoff and Marcel Knopp and Maximilian Rokuss and Elisa Stegmeier and Philipp Schader and Dasha Trofimova and Raphael Stock and Kim-Celine Kahl and Stephen Schaumann and Selen Erkan and David Zimmerer and Stefan Denner and Moritz Langenberg and Sebastian Ziegler and Katharina Eckstein and Maximilian Fischer and Jonathan Suprijadi and Bálint Kovács and Benjamin Hamm and Anand Deshpande and Dimitrios Bounias and Nico Disch and Shuhan Xiao and Jessica Kächele and Jan Sellner and Rajesh Baidya and Jeremias Traub and Lars Krämer and Maximilian Zenk and Tim Rädsch and Stefan Dvoretskii and Robin Peretzke and Jonathan Deissler and Alexandra Ertl and Partha Ghosh and Kris Dreher and Stefan Dinkelacker and Annika Reinke and Evangelia Christodoulou and Numan Saeed and Yoland Savriama and Santiago Estrada and David Kügler and Laura Alexandra Daza Barragan and Cristina Isabel Gonzalez Osorio and Jan Peeken and Michael Baumgartner and Marvin Teichmann and Guillaume Chabin and Matthias Kirchler and Valentin Koch and for the ALFA study and Markus Hohenhaus and Dimitri Koslov and Nina Decker and Mohammad Yaqub and Arnd Heuser and Martin Reuter and Julia A. Schnabel and Tobias Heimann and Florin Ghesu and Paul Brachmann and Claus P. Heußel and Alexander Radbruch and Gianluca Brugnara and Aditya Rastogi and Martha Foltyn-Dumitru and Heinz-Peter Schlemmer and Ignaz Reicht and Julius C. Holzschuh and Michael Bach and Bram Stieltjes and Kai Schlamp and Lena Maier-Hein and Marco Nolden and Ralf Floca and Paul F. Jäger and Philipp Vollmuth and Fabian Isensee and Klaus H. Maier-Hein},
year={2026},
eprint={2609.26924},
archivePrefix={arXiv},
primaryClass={cs.CV},
url={https://arxiv.org/abs/2609.26924},
}
If you use the
nnssl
framework, the
OpenMind dataset
, or the
OpenMind checkpoints
, please cite:
OpenMind BibTeX
@InProceedings{Wald_2025_ICCV,
author = {Wald, Tassilo and Ulrich, Constantin and Suprijadi, Jonathan and Ziegler, Sebastian and Nohel, Michal and Peretzke, Robin and Kohler, Gregor and Maier-Hein, Klaus},
title = {An OpenMind for 3D Medical Vision Self-supervised Learning},
booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
month = {October},
year = {2025},
pages = {23839-23879}
}
Runs of MIC-DKFZ nnFoundationViT on huggingface.co
282
Total runs
11
24-hour runs
25
3-day runs
77
7-day runs
268
30-day runs
More Information About nnFoundationViT huggingface.co Model
Url of nnFoundationViT
nnFoundationViT huggingface.co Url
Provider of nnFoundationViT huggingface.co
Other API from MIC-DKFZ
Updated:October 08 2026
Total runs:
160
Run Growth:
115
Growth Rate:
72.78%
Total runs:
32
Run Growth:
-6
Growth Rate:
-18.18%
Total runs:
25
Run Growth:
17
Growth Rate:
68.00%
Total runs:
20
Run Growth:
18
Growth Rate:
90.00%
Total runs:
19
Run Growth:
-2
Growth Rate:
-10.00%
Total runs:
19
Run Growth:
17
Growth Rate:
89.47%
Total runs:
18
Run Growth:
3
Growth Rate:
15.79%
Total runs:
16
Run Growth:
7
Growth Rate:
41.18%
Total runs:
15
Run Growth:
-3
Growth Rate:
-17.65%
Total runs:
9
Run Growth:
7
Growth Rate:
77.78%
Total runs:
9
Run Growth:
7
Growth Rate:
77.78%
Total runs:
8
Run Growth:
6
Growth Rate:
75.00%
Total runs:
8
Run Growth:
6
Growth Rate:
75.00%