Sponsored by
APIMart
zeromodels / deit3_small_patch16_224_fb_in22k_ft_in1k
Model's Last Updated: August 30 2026
image-classification
Introduction of deit3_small_patch16_224_fb_in22k_ft_in1k
Model Details of deit3_small_patch16_224_fb_in22k_ft_in1k
See our collection for all versions of DeiT.
Run DeiT with Keras 3: JAX, PyTorch, or TensorFlow
zeromodels/deit3_small_patch16_224_fb_in22k_ft_in1k
Paper: Training data-efficient image transformers and distillation through attention (arXiv:2012.12877) · HF Papers
DeiT / DeiT3 are data-efficient ViT variants (distillation token in DeiT; improved training recipe in DeiT3). Same ImageClassify / Model API.
For more details on the model, please go to the upstream model card .
Pure-
Keras 3
conversion of
timm/deit3_small_patch16_224.fb_in22k_ft_in1k
for
zeromodels
. One implementation runs unmodified on
TensorFlow / Torch / JAX
.
This is an
image-classification / backbone
checkpoint (
DeiTImageClassify
/
DeiTModel
).
✨ Quick start
import os
os.environ["KERAS_BACKEND"] = "torch" # or "jax" / "tensorflow"
from PIL import Image
import numpy as np
from zeromodels.models.deit import DeiTImageClassify, DeiTModel
model = DeiTImageClassify.from_weights("zeromodels/deit3_small_patch16_224_fb_in22k_ft_in1k")
backbone = DeiTModel.from_weights(
"zeromodels/deit3_small_patch16_224_fb_in22k_ft_in1k", as_backbone=True
)
image = Image.open("your_image.jpg").convert("RGB")
image = image.resize((224, 224))
x = np.asarray(image, dtype="float32")[None] # (1, H, W, 3)
print(model(x).shape) # (1, num_classes)
feats = backbone(x)
print(len(feats), [tuple(f.shape) for f in feats])
Load any DeiT variant the same way with
from_weights("zeromodels/<variant>")
:
Tips
-
Set
KERAS_BACKENDbefore importing Keras / zeromodels. -
DeiTImageClassifyreturns class logits;DeiTModelreturns features (as_backbone=Truefor multi-scale stages). - See docs and Loading Weights .
-
Upstream / timm checkpoints:
DeiTImageClassify.from_weights("hf:timm/deit3_small_patch16_224.fb_in22k_ft_in1k").
Special Thanks
A huge thank you to the DeiT authors and the timm / Hub communities for creating and releasing these models.
License: see YAML
license
(usually matches the upstream checkpoint).
Runs of zeromodels deit3_small_patch16_224_fb_in22k_ft_in1k on huggingface.co
46
Total runs
1
24-hour runs
3
3-day runs
2
7-day runs
8
30-day runs
More Information About deit3_small_patch16_224_fb_in22k_ft_in1k huggingface.co Model
Url of deit3_small_patch16_224_fb_in22k_ft_in1k
deit3_small_patch16_224_fb_in22k_ft_in1k huggingface.co Url
Provider of deit3_small_patch16_224_fb_in22k_ft_in1k huggingface.co
Other API from zeromodels
Total runs:
505
Run Growth:
462
Growth Rate:
91.49%
Total runs:
493
Run Growth:
459
Growth Rate:
93.10%
Total runs:
470
Run Growth:
372
Growth Rate:
79.15%
Total runs:
441
Run Growth:
-14
Growth Rate:
-3.17%
Total runs:
251
Run Growth:
-18
Growth Rate:
-7.17%
Total runs:
152
Run Growth:
116
Growth Rate:
76.82%
Total runs:
145
Run Growth:
112
Growth Rate:
77.24%
Total runs:
141
Run Growth:
65
Growth Rate:
46.10%
Total runs:
129
Run Growth:
-5
Growth Rate:
-3.88%
Total runs:
121
Run Growth:
-7
Growth Rate:
-5.79%
Total runs:
74
Run Growth:
-213
Growth Rate:
-287.84%
Total runs:
65
Run Growth:
4
Growth Rate:
6.15%
Total runs:
64
Run Growth:
-20
Growth Rate:
-31.25%
Total runs:
54
Run Growth:
7
Growth Rate:
12.96%
Total runs:
53
Run Growth:
11
Growth Rate:
20.75%
Total runs:
50
Run Growth:
0
Growth Rate:
0.00%
Total runs:
50
Run Growth:
17
Growth Rate:
35.42%
Total runs:
50
Run Growth:
-583
Growth Rate:
-1166.00%
Total runs:
50
Run Growth:
7
Growth Rate:
14.00%
Total runs:
49
Run Growth:
12
Growth Rate:
24.49%
Total runs:
48
Run Growth:
-55
Growth Rate:
-114.58%
Total runs:
48
Run Growth:
-114
Growth Rate:
-237.50%
Total runs:
48
Run Growth:
10
Growth Rate:
20.83%
Total runs:
48
Run Growth:
-5
Growth Rate:
-10.42%
Total runs:
48
Run Growth:
-540
Growth Rate:
-1125.00%
Total runs:
48
Run Growth:
8
Growth Rate:
16.67%
Total runs:
48
Run Growth:
-80
Growth Rate:
-166.67%
Total runs:
47
Run Growth:
3
Growth Rate:
6.38%
Total runs:
47
Run Growth:
-3
Growth Rate:
-6.38%
Total runs:
46
Run Growth:
-6
Growth Rate:
-13.04%
Total runs:
46
Run Growth:
-5
Growth Rate:
-10.87%
Total runs:
45
Run Growth:
10
Growth Rate:
22.22%
Total runs:
45
Run Growth:
5
Growth Rate:
11.11%
Total runs:
45
Run Growth:
6
Growth Rate:
13.33%
Total runs:
44
Run Growth:
8
Growth Rate:
18.18%
Total runs:
44
Run Growth:
10
Growth Rate:
22.73%
Total runs:
44
Run Growth:
-829
Growth Rate:
-1884.09%
Total runs:
44
Run Growth:
1
Growth Rate:
2.27%
Total runs:
44
Run Growth:
4
Growth Rate:
9.09%
Total runs:
44
Run Growth:
8
Growth Rate:
18.18%
Total runs:
44
Run Growth:
4
Growth Rate:
9.09%
Total runs:
43
Run Growth:
-7
Growth Rate:
-16.28%
Total runs:
43
Run Growth:
32
Growth Rate:
74.42%
Total runs:
43
Run Growth:
43
Growth Rate:
100.00%
Total runs:
43
Run Growth:
-3
Growth Rate:
-6.98%
Total runs:
43
Run Growth:
-4
Growth Rate:
-9.30%
Total runs:
42
Run Growth:
8
Growth Rate:
19.05%
Total runs:
42
Run Growth:
6
Growth Rate:
14.29%
Total runs:
42
Run Growth:
-2
Growth Rate:
-4.76%
Total runs:
42
Run Growth:
-628
Growth Rate:
-1495.24%
Total runs:
42
Run Growth:
4
Growth Rate:
9.52%
Total runs:
42
Run Growth:
10
Growth Rate:
23.81%
Total runs:
42
Run Growth:
0
Growth Rate:
0.00%
Total runs:
41
Run Growth:
3
Growth Rate:
7.32%
Total runs:
41
Run Growth:
2
Growth Rate:
4.88%
Total runs:
41
Run Growth:
-2
Growth Rate:
-4.88%
Total runs:
41
Run Growth:
2
Growth Rate:
4.88%
Total runs:
41
Run Growth:
5
Growth Rate:
12.20%
Total runs:
41
Run Growth:
0
Growth Rate:
0.00%
Total runs:
41
Run Growth:
3
Growth Rate:
7.32%
Total runs:
41
Run Growth:
-2
Growth Rate:
-4.88%
Total runs:
40
Run Growth:
4
Growth Rate:
10.00%
Total runs:
40
Run Growth:
6
Growth Rate:
15.00%
Total runs:
40
Run Growth:
-7
Growth Rate:
-17.50%
Total runs:
40
Run Growth:
12
Growth Rate:
30.00%
Total runs:
40
Run Growth:
5
Growth Rate:
12.50%
Total runs:
39
Run Growth:
-3
Growth Rate:
-7.69%
Total runs:
39
Run Growth:
2
Growth Rate:
5.13%
Total runs:
39
Run Growth:
7
Growth Rate:
18.42%
Total runs:
39
Run Growth:
5
Growth Rate:
12.82%
Total runs:
39
Run Growth:
0
Growth Rate:
0.00%
Total runs:
39
Run Growth:
-1
Growth Rate:
-2.56%
Total runs:
39
Run Growth:
3
Growth Rate:
7.69%
Total runs:
39
Run Growth:
-2
Growth Rate:
-5.13%
Total runs:
39
Run Growth:
5
Growth Rate:
12.82%
Total runs:
38
Run Growth:
0
Growth Rate:
0.00%
Total runs:
38
Run Growth:
3
Growth Rate:
7.89%
Total runs:
38
Run Growth:
-7
Growth Rate:
-18.42%
Total runs:
38
Run Growth:
-2
Growth Rate:
-5.26%
Total runs:
38
Run Growth:
7
Growth Rate:
18.42%
Total runs:
38
Run Growth:
4
Growth Rate:
10.53%
Total runs:
38
Run Growth:
0
Growth Rate:
0.00%
Total runs:
37
Run Growth:
-6
Growth Rate:
-16.22%
Total runs:
37
Run Growth:
-5
Growth Rate:
-13.51%
Total runs:
37
Run Growth:
-8
Growth Rate:
-21.62%
Total runs:
37
Run Growth:
7
Growth Rate:
18.92%
Total runs:
37
Run Growth:
-19
Growth Rate:
-51.35%
Total runs:
37
Run Growth:
2
Growth Rate:
5.41%
Total runs:
37
Run Growth:
-101
Growth Rate:
-272.97%
Total runs:
37
Run Growth:
4
Growth Rate:
10.81%
Total runs:
37
Run Growth:
-6
Growth Rate:
-16.22%
Total runs:
36
Run Growth:
5
Growth Rate:
13.89%
Total runs:
36
Run Growth:
-2
Growth Rate:
-5.56%
Total runs:
36
Run Growth:
-4
Growth Rate:
-11.11%
Total runs:
36
Run Growth:
-6
Growth Rate:
-16.67%
Total runs:
36
Run Growth:
-2
Growth Rate:
-5.56%