Total runs:
3.6M
Run Growth:
257.5K
Growth Rate:
7.14%
Sponsored by
Skywork
microsoft / xclip-base-patch16
Model's Last Updated: October 28 2024
video-classification
Introduction of xclip-base-patch16
Model Details of xclip-base-patch16
X-CLIP (base-sized model)
X-CLIP model (base-sized, patch resolution of 16) trained fully-supervised on Kinetics-400 . It was introduced in the paper Expanding Language-Image Pretrained Models for General Video Recognition by Ni et al. and first released in this repository .
This model was trained using 8 frames per video, at a resolution of 224x224.
Disclaimer: The team releasing X-CLIP did not write a model card for this model so this model card has been written by the Hugging Face team.
Model description
X-CLIP is a minimal extension of CLIP for general video-language understanding. The model is trained in a contrastive way on (video, text) pairs.
This allows the model to be used for tasks like zero-shot, few-shot or fully supervised video classification and video-text retrieval.
Intended uses & limitations
You can use the raw model for determining how well text goes with a given video. See the model hub to look for fine-tuned versions on a task that interests you.
How to use
For code examples, we refer to the documentation .
Training data
This model was trained on Kinetics-400 .
Preprocessing
The exact details of preprocessing during training can be found here .
The exact details of preprocessing during validation can be found here .
During validation, one resizes the shorter edge of each frame, after which center cropping is performed to a fixed-size resolution (like 224x224). Next, frames are normalized across the RGB channels with the ImageNet mean and standard deviation.
Evaluation results
This model achieves a top-1 accuracy of 83.8% and a top-5 accuracy of 95.7%.
Runs of microsoft xclip-base-patch16 on huggingface.co
11.8K
Total runs
0
24-hour runs
440
3-day runs
4.3K
7-day runs
5.3K
30-day runs
More Information About xclip-base-patch16 huggingface.co Model
Url of xclip-base-patch16
xclip-base-patch16 huggingface.co Url
Provider of xclip-base-patch16 huggingface.co
Other API from microsoft
Updated:September 06 2023
Total runs:
2.4M
Run Growth:
96.1K
Growth Rate:
3.98%
Total runs:
2.4M
Run Growth:
-989.9K
Growth Rate:
-42.06%
Total runs:
1.7M
Run Growth:
823.3K
Growth Rate:
47.42%
Total runs:
1.6M
Run Growth:
1.3M
Growth Rate:
85.19%
Total runs:
1.5M
Run Growth:
322.2K
Growth Rate:
21.16%
Total runs:
1.5M
Run Growth:
906.0K
Growth Rate:
60.80%
Total runs:
1.4M
Run Growth:
208.3K
Growth Rate:
15.00%
Total runs:
1.3M
Run Growth:
54.2K
Growth Rate:
4.26%
Total runs:
1.2M
Run Growth:
865.4K
Growth Rate:
70.40%
Total runs:
945.8K
Run Growth:
-95.9K
Growth Rate:
-10.14%
Total runs:
911.0K
Run Growth:
13.4K
Growth Rate:
1.47%
Total runs:
904.8K
Run Growth:
-231.9K
Growth Rate:
-24.29%
Total runs:
865.1K
Run Growth:
260.4K
Growth Rate:
30.10%
Total runs:
755.6K
Run Growth:
8.6K
Growth Rate:
1.14%
Total runs:
739.0K
Run Growth:
158.4K
Growth Rate:
21.46%
Total runs:
734.9K
Run Growth:
-187.5K
Growth Rate:
-25.63%
Total runs:
717.2K
Run Growth:
-433.9K
Growth Rate:
-60.50%
Total runs:
672.1K
Run Growth:
138.0K
Growth Rate:
20.35%
Total runs:
645.0K
Run Growth:
-163.9K
Growth Rate:
-25.51%
Total runs:
627.0K
Run Growth:
-92.9K
Growth Rate:
-14.82%
Total runs:
598.1K
Run Growth:
-101.2K
Growth Rate:
-16.92%
Total runs:
592.6K
Run Growth:
40.4K
Growth Rate:
6.82%
Total runs:
588.9K
Run Growth:
-568.8K
Growth Rate:
-96.58%
Total runs:
588.3K
Run Growth:
-44.4K
Growth Rate:
-7.54%
Total runs:
575.6K
Run Growth:
221.3K
Growth Rate:
38.44%
Total runs:
530.0K
Run Growth:
343.1K
Growth Rate:
64.72%
Total runs:
484.5K
Run Growth:
-221.9K
Growth Rate:
-42.77%
Total runs:
426.8K
Run Growth:
-199.8K
Growth Rate:
-46.82%
Total runs:
398.2K
Run Growth:
397.1K
Growth Rate:
99.71%
Total runs:
387.5K
Run Growth:
5.4K
Growth Rate:
1.40%
Total runs:
365.8K
Run Growth:
56.5K
Growth Rate:
15.50%
Total runs:
356.5K
Run Growth:
130.8K
Growth Rate:
36.70%
Total runs:
355.1K
Run Growth:
148.0K
Growth Rate:
41.69%
Total runs:
336.8K
Run Growth:
99.8K
Growth Rate:
29.62%
Total runs:
307.5K
Run Growth:
95.0K
Growth Rate:
30.65%
Total runs:
304.1K
Run Growth:
11.9K
Growth Rate:
3.93%
Total runs:
278.8K
Run Growth:
-31.3K
Growth Rate:
-11.22%
Total runs:
255.2K
Run Growth:
9.9K
Growth Rate:
3.89%
Total runs:
234.0K
Run Growth:
127.7K
Growth Rate:
54.59%
Total runs:
219.5K
Run Growth:
193.4K
Growth Rate:
88.07%
Total runs:
210.0K
Run Growth:
136.8K
Growth Rate:
68.59%
Total runs:
190.6K
Run Growth:
-135.1K
Growth Rate:
-70.91%
Total runs:
187.3K
Run Growth:
-3.1K
Growth Rate:
-1.65%
Total runs:
182.0K
Run Growth:
48.4K
Growth Rate:
26.57%
Total runs:
162.1K
Run Growth:
-6.5K
Growth Rate:
-4.04%
Total runs:
161.0K
Run Growth:
156.2K
Growth Rate:
100.00%
Total runs:
154.2K
Run Growth:
-13.0K
Growth Rate:
-8.40%
Total runs:
149.8K
Run Growth:
38.6K
Growth Rate:
25.78%
Total runs:
148.8K
Run Growth:
-607.4K
Growth Rate:
-408.20%
Total runs:
145.7K
Run Growth:
21.3K
Growth Rate:
14.65%
Total runs:
144.8K
Run Growth:
-43.5K
Growth Rate:
-30.05%
Total runs:
133.4K
Run Growth:
-54.5K
Growth Rate:
-40.83%
Total runs:
131.1K
Run Growth:
-42.0K
Growth Rate:
-32.00%
Total runs:
129.9K
Run Growth:
26.8K
Growth Rate:
20.87%
Total runs:
129.3K
Run Growth:
35.1K
Growth Rate:
27.12%
Total runs:
128.9K
Run Growth:
-2.9K
Growth Rate:
-2.27%
Total runs:
128.6K
Run Growth:
-162.3K
Growth Rate:
-126.23%
Total runs:
125.3K
Run Growth:
8.5K
Growth Rate:
6.75%
Total runs:
122.1K
Run Growth:
-284.3K
Growth Rate:
-232.77%
Total runs:
109.1K
Run Growth:
-39.3K
Growth Rate:
-36.02%
Total runs:
104.4K
Run Growth:
7.9K
Growth Rate:
7.54%
Total runs:
89.0K
Run Growth:
-43.0K
Growth Rate:
-48.31%
Total runs:
88.8K
Run Growth:
-40.6K
Growth Rate:
-45.77%
Total runs:
86.9K
Run Growth:
86.0K
Growth Rate:
100.00%
Total runs:
86.8K
Run Growth:
74.3K
Growth Rate:
85.61%
Total runs:
84.2K
Run Growth:
-35.3K
Growth Rate:
-41.85%
Total runs:
83.8K
Run Growth:
71.8K
Growth Rate:
85.66%
Total runs:
78.5K
Run Growth:
-18.5K
Growth Rate:
-23.62%
Total runs:
74.1K
Run Growth:
-20.4K
Growth Rate:
-27.54%
Total runs:
72.2K
Run Growth:
45.8K
Growth Rate:
63.45%
Total runs:
72.1K
Run Growth:
-30.7K
Growth Rate:
-42.63%
Total runs:
71.9K
Run Growth:
881
Growth Rate:
1.22%
Total runs:
68.1K
Run Growth:
11.6K
Growth Rate:
17.08%
Total runs:
67.6K
Run Growth:
33.9K
Growth Rate:
49.74%
Total runs:
62.9K
Run Growth:
3.6K
Growth Rate:
5.67%
Total runs:
60.4K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
57.7K
Run Growth:
-57.4K
Growth Rate:
-99.47%
Total runs:
56.1K
Run Growth:
44.4K
Growth Rate:
79.06%
Total runs:
52.9K
Run Growth:
14.7K
Growth Rate:
27.80%
Total runs:
51.0K
Run Growth:
39.8K
Growth Rate:
77.97%
Total runs:
49.0K
Run Growth:
11.4K
Growth Rate:
23.37%
Total runs:
43.3K
Run Growth:
11.9K
Growth Rate:
27.41%
Total runs:
42.4K
Run Growth:
-11.0K
Growth Rate:
-26.03%
Total runs:
41.6K
Run Growth:
9.5K
Growth Rate:
22.90%
Total runs:
39.0K
Run Growth:
18.9K
Growth Rate:
48.35%
Total runs:
38.9K
Run Growth:
38.1K
Growth Rate:
100.00%
Total runs:
34.2K
Run Growth:
-25.8K
Growth Rate:
-75.33%
Total runs:
33.0K
Run Growth:
-1.3K
Growth Rate:
-3.81%
Total runs:
32.7K
Run Growth:
7.6K
Growth Rate:
23.13%
Total runs:
32.1K
Run Growth:
13.0K
Growth Rate:
40.48%
Total runs:
31.7K
Run Growth:
-8.7K
Growth Rate:
-27.27%
Total runs:
31.0K
Run Growth:
-8.1K
Growth Rate:
-26.25%
Total runs:
30.4K
Run Growth:
-7.5K
Growth Rate:
-24.82%
Total runs:
28.1K
Run Growth:
-9.9K
Growth Rate:
-35.15%
Total runs:
24.5K
Run Growth:
21.4K
Growth Rate:
87.26%