Sponsored by
Vmake Labs Video Enhancer
keras-io / conv_Mixer
Model's Last Updated: July 05 2024
image-classification
Introduction of conv_Mixer
Model Details of conv_Mixer
Tensorflow Keras implementation of : Image classification with ConvMixer
The full credit goes to: Sayak Paul
Short description:
ConvMixer is a simple model based on the ideas of representing an image as patches( used in ViT) and separating the mixing of Spatial and channel dimensions (used in MLP-Mixer). Unlike ViT and MLP-Mixer, they use only standard Convolution operations. The full paper is a submission to ICLR 22 and can be found here
Model and Dataset used
The Dataset used here is CIFAR-10. The model is called ConvMixer-256/8 where 256 is the hidden dimension (the dimension of patches) and 8 is the depth(number of repetitions of ConvMix layers)
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
| Hyperparameters | Value |
|---|---|
| name | AdamW |
| learning_rate | 0.0010000000474974513 |
| decay | 0.0 |
| beta_1 | 0.8999999761581421 |
| beta_2 | 0.9990000128746033 |
| epsilon | 1e-07 |
| amsgrad | False |
| weight_decay | 9.999999747378752e-05 |
| exclude_from_weight_decay | None |
| training_precision | float32 |
Training Metrics
After 10 Epocs, the test accuracy of the model is 83.57%
Model Plot
View Model Plot
Runs of keras-io conv_Mixer on huggingface.co
21
Total runs
-3
24-hour runs
-8
3-day runs
-17
7-day runs
-2
30-day runs
More Information About conv_Mixer huggingface.co Model
Url of conv_Mixer
conv_Mixer huggingface.co Url
Provider of conv_Mixer huggingface.co
Other API from keras-io
Total runs:
69
Run Growth:
-43
Growth Rate:
-55.84%
Total runs:
58
Run Growth:
6
Growth Rate:
10.34%
Total runs:
52
Run Growth:
22
Growth Rate:
42.31%
Total runs:
48
Run Growth:
17
Growth Rate:
34.69%
Total runs:
47
Run Growth:
11
Growth Rate:
25.58%
Total runs:
42
Run Growth:
-2
Growth Rate:
-4.76%
Total runs:
39
Run Growth:
-13
Growth Rate:
-30.95%
Total runs:
39
Run Growth:
7
Growth Rate:
15.91%
Total runs:
36
Run Growth:
-7
Growth Rate:
-19.44%
Total runs:
36
Run Growth:
-6
Growth Rate:
-16.67%
Total runs:
33
Run Growth:
9
Growth Rate:
27.27%
Total runs:
33
Run Growth:
16
Growth Rate:
48.48%
Total runs:
32
Run Growth:
6
Growth Rate:
18.75%
Total runs:
32
Run Growth:
-9
Growth Rate:
-28.13%
Total runs:
31
Run Growth:
-2
Growth Rate:
-6.45%
Total runs:
31
Run Growth:
11
Growth Rate:
35.48%
Total runs:
30
Run Growth:
4
Growth Rate:
12.90%
Total runs:
30
Run Growth:
19
Growth Rate:
63.33%
Total runs:
25
Run Growth:
12
Growth Rate:
48.00%
Total runs:
25
Run Growth:
3
Growth Rate:
12.00%
Total runs:
25
Run Growth:
-11
Growth Rate:
-44.00%
Total runs:
23
Run Growth:
-9
Growth Rate:
-37.50%
Total runs:
22
Run Growth:
-2
Growth Rate:
-9.09%
Total runs:
21
Run Growth:
-89
Growth Rate:
-445.00%
Total runs:
21
Run Growth:
10
Growth Rate:
47.62%
Total runs:
19
Run Growth:
4
Growth Rate:
21.05%
Total runs:
19
Run Growth:
3
Growth Rate:
15.79%
Total runs:
18
Run Growth:
-21
Growth Rate:
-131.25%
Total runs:
18
Run Growth:
-5
Growth Rate:
-27.78%
Total runs:
18
Run Growth:
3
Growth Rate:
16.67%
Total runs:
17
Run Growth:
0
Growth Rate:
0.00%
Total runs:
17
Run Growth:
-7
Growth Rate:
-41.18%
Total runs:
15
Run Growth:
-6
Growth Rate:
-40.00%
Total runs:
15
Run Growth:
8
Growth Rate:
53.33%
Total runs:
13
Run Growth:
-9
Growth Rate:
-69.23%
Total runs:
13
Run Growth:
0
Growth Rate:
0.00%
Total runs:
12
Run Growth:
4
Growth Rate:
28.57%
Total runs:
12
Run Growth:
-3
Growth Rate:
-25.00%
Total runs:
11
Run Growth:
-4
Growth Rate:
-33.33%
Total runs:
11
Run Growth:
-3
Growth Rate:
-33.33%
Total runs:
11
Run Growth:
1
Growth Rate:
9.09%
Total runs:
10
Run Growth:
-2
Growth Rate:
-20.00%
Total runs:
8
Run Growth:
-10
Growth Rate:
-111.11%
Total runs:
7
Run Growth:
-6
Growth Rate:
-100.00%
Total runs:
7
Run Growth:
3
Growth Rate:
42.86%
Total runs:
7
Run Growth:
-65
Growth Rate:
-812.50%
Total runs:
7
Run Growth:
-12
Growth Rate:
-109.09%
Total runs:
5
Run Growth:
-5
Growth Rate:
-100.00%
Total runs:
5
Run Growth:
-10
Growth Rate:
-200.00%
Total runs:
5
Run Growth:
-24
Growth Rate:
-480.00%
Total runs:
4
Run Growth:
3
Growth Rate:
75.00%
Total runs:
4
Run Growth:
-1
Growth Rate:
-25.00%
Total runs:
4
Run Growth:
-7
Growth Rate:
-175.00%
Total runs:
4
Run Growth:
-3
Growth Rate:
-50.00%
Total runs:
3
Run Growth:
-16
Growth Rate:
-533.33%
Total runs:
3
Run Growth:
1
Growth Rate:
33.33%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%