Total runs:
3.5M
Run Growth:
143.1K
Growth Rate:
4.08%
Sponsored by
APIMart
microsoft / xclip-base-patch32-16-frames
Model's Last Updated: October 28 2024
video-classification
Introduction of xclip-base-patch32-16-frames
Model Details of xclip-base-patch32-16-frames
X-CLIP (base-sized model)
X-CLIP model (base-sized, patch resolution of 32) trained fully-supervised on Kinetics-400 . It was introduced in the paper Expanding Language-Image Pretrained Models for General Video Recognition by Ni et al. and first released in this repository .
This model was trained using 16 frames per video, at a resolution of 224x224.
Disclaimer: The team releasing X-CLIP did not write a model card for this model so this model card has been written by the Hugging Face team.
Model description
X-CLIP is a minimal extension of CLIP for general video-language understanding. The model is trained in a contrastive way on (video, text) pairs.
This allows the model to be used for tasks like zero-shot, few-shot or fully supervised video classification and video-text retrieval.
Intended uses & limitations
You can use the raw model for determining how well text goes with a given video. See the model hub to look for fine-tuned versions on a task that interests you.
How to use
For code examples, we refer to the documentation .
Training data
This model was trained on Kinetics-400 .
Preprocessing
The exact details of preprocessing during training can be found here .
The exact details of preprocessing during validation can be found here .
During validation, one resizes the shorter edge of each frame, after which center cropping is performed to a fixed-size resolution (like 224x224). Next, frames are normalized across the RGB channels with the ImageNet mean and standard deviation.
Evaluation results
This model achieves a top-1 accuracy of 81.1% and a top-5 accuracy of 95.5%.
Runs of microsoft xclip-base-patch32-16-frames on huggingface.co
7.6K
Total runs
0
24-hour runs
-50
3-day runs
-8.4K
7-day runs
-9.0K
30-day runs
More Information About xclip-base-patch32-16-frames huggingface.co Model
Url of xclip-base-patch32-16-frames
xclip-base-patch32-16-frames huggingface.co Url
Provider of xclip-base-patch32-16-frames huggingface.co
Other API from microsoft
Updated:September 06 2023
Total runs:
2.4M
Run Growth:
140.7K
Growth Rate:
5.79%
Total runs:
2.4M
Run Growth:
-989.9K
Growth Rate:
-42.06%
Total runs:
1.8M
Run Growth:
865.9K
Growth Rate:
49.46%
Total runs:
1.5M
Run Growth:
322.2K
Growth Rate:
21.16%
Total runs:
1.5M
Run Growth:
906.0K
Growth Rate:
60.80%
Total runs:
1.4M
Run Growth:
1.2M
Growth Rate:
83.71%
Total runs:
1.4M
Run Growth:
226.8K
Growth Rate:
16.11%
Total runs:
1.3M
Run Growth:
58.4K
Growth Rate:
4.57%
Total runs:
1.2M
Run Growth:
865.4K
Growth Rate:
70.40%
Total runs:
967.8K
Run Growth:
-57.2K
Growth Rate:
-5.91%
Total runs:
954.6K
Run Growth:
-231.9K
Growth Rate:
-24.29%
Total runs:
910.1K
Run Growth:
12.5K
Growth Rate:
1.37%
Total runs:
861.2K
Run Growth:
267.8K
Growth Rate:
31.09%
Total runs:
753.8K
Run Growth:
9.8K
Growth Rate:
1.29%
Total runs:
738.0K
Run Growth:
146.4K
Growth Rate:
20.00%
Total runs:
734.9K
Run Growth:
-187.5K
Growth Rate:
-25.63%
Total runs:
719.9K
Run Growth:
-416.9K
Growth Rate:
-57.91%
Total runs:
677.9K
Run Growth:
138.0K
Growth Rate:
20.35%
Total runs:
670.8K
Run Growth:
-982.2K
Growth Rate:
-146.44%
Total runs:
642.5K
Run Growth:
-163.9K
Growth Rate:
-25.51%
Total runs:
601.0K
Run Growth:
-147.8K
Growth Rate:
-24.59%
Total runs:
589.7K
Run Growth:
-43.0K
Growth Rate:
-7.28%
Total runs:
589.1K
Run Growth:
37.0K
Growth Rate:
6.28%
Total runs:
580.6K
Run Growth:
-156.4K
Growth Rate:
-26.94%
Total runs:
576.5K
Run Growth:
-578.6K
Growth Rate:
-100.36%
Total runs:
572.6K
Run Growth:
218.2K
Growth Rate:
38.12%
Total runs:
518.9K
Run Growth:
-221.9K
Growth Rate:
-42.77%
Total runs:
488.0K
Run Growth:
301.0K
Growth Rate:
61.68%
Total runs:
443.5K
Run Growth:
-193.3K
Growth Rate:
-43.59%
Total runs:
398.2K
Run Growth:
397.1K
Growth Rate:
99.71%
Total runs:
388.5K
Run Growth:
6.4K
Growth Rate:
1.64%
Total runs:
371.7K
Run Growth:
164.6K
Growth Rate:
44.29%
Total runs:
365.8K
Run Growth:
56.5K
Growth Rate:
15.50%
Total runs:
357.1K
Run Growth:
131.5K
Growth Rate:
36.81%
Total runs:
336.8K
Run Growth:
99.8K
Growth Rate:
29.63%
Total runs:
309.9K
Run Growth:
115.1K
Growth Rate:
36.40%
Total runs:
306.0K
Run Growth:
-49.3K
Growth Rate:
-16.10%
Total runs:
294.8K
Run Growth:
110
Growth Rate:
0.04%
Total runs:
255.2K
Run Growth:
11.2K
Growth Rate:
4.36%
Total runs:
233.4K
Run Growth:
127.2K
Growth Rate:
54.49%
Total runs:
207.9K
Run Growth:
181.6K
Growth Rate:
87.38%
Total runs:
204.4K
Run Growth:
-111.4K
Growth Rate:
-54.49%
Total runs:
199.4K
Run Growth:
136.8K
Growth Rate:
68.59%
Total runs:
187.3K
Run Growth:
-3.1K
Growth Rate:
-1.63%
Total runs:
178.7K
Run Growth:
45.0K
Growth Rate:
25.18%
Total runs:
169.9K
Run Growth:
-586.2K
Growth Rate:
-344.94%
Total runs:
162.0K
Run Growth:
-6.6K
Growth Rate:
-4.10%
Total runs:
156.2K
Run Growth:
150.7K
Growth Rate:
100.00%
Total runs:
155.3K
Run Growth:
-10.6K
Growth Rate:
-6.85%
Total runs:
152.5K
Run Growth:
28.1K
Growth Rate:
18.44%
Total runs:
146.3K
Run Growth:
-40.6K
Growth Rate:
-27.76%
Total runs:
141.9K
Run Growth:
31.3K
Growth Rate:
22.08%
Total runs:
130.5K
Run Growth:
-57.4K
Growth Rate:
-43.96%
Total runs:
129.8K
Run Growth:
-160.0K
Growth Rate:
-123.33%
Total runs:
129.6K
Run Growth:
-43.5K
Growth Rate:
-33.53%
Total runs:
128.3K
Run Growth:
26.8K
Growth Rate:
20.87%
Total runs:
129.3K
Run Growth:
33.7K
Growth Rate:
26.34%
Total runs:
125.3K
Run Growth:
3.6K
Growth Rate:
2.86%
Total runs:
125.2K
Run Growth:
-6.6K
Growth Rate:
-5.31%
Total runs:
124.0K
Run Growth:
-349.4K
Growth Rate:
-281.90%
Total runs:
110.2K
Run Growth:
-38.1K
Growth Rate:
-34.60%
Total runs:
104.4K
Run Growth:
7.9K
Growth Rate:
7.54%
Total runs:
90.0K
Run Growth:
-40.8K
Growth Rate:
-45.36%
Total runs:
89.9K
Run Growth:
-39.5K
Growth Rate:
-43.94%
Total runs:
86.0K
Run Growth:
84.5K
Growth Rate:
100.00%
Total runs:
85.2K
Run Growth:
-34.3K
Growth Rate:
-40.32%
Total runs:
81.7K
Run Growth:
69.2K
Growth Rate:
84.71%
Total runs:
81.0K
Run Growth:
-16.0K
Growth Rate:
-19.77%
Total runs:
78.5K
Run Growth:
66.3K
Growth Rate:
84.39%
Total runs:
74.1K
Run Growth:
-22.8K
Growth Rate:
-30.73%
Total runs:
73.1K
Run Growth:
-29.7K
Growth Rate:
-40.63%
Total runs:
72.2K
Run Growth:
45.8K
Growth Rate:
63.45%
Total runs:
71.6K
Run Growth:
527
Growth Rate:
0.74%
Total runs:
68.3K
Run Growth:
11.8K
Growth Rate:
17.28%
Total runs:
68.2K
Run Growth:
33.9K
Growth Rate:
49.74%
Total runs:
60.4K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
62.9K
Run Growth:
1.5K
Growth Rate:
2.48%
Total runs:
57.6K
Run Growth:
-51.6K
Growth Rate:
-89.52%
Total runs:
56.1K
Run Growth:
44.1K
Growth Rate:
78.95%
Total runs:
53.0K
Run Growth:
15.2K
Growth Rate:
28.77%
Total runs:
49.0K
Run Growth:
11.4K
Growth Rate:
23.37%
Total runs:
48.4K
Run Growth:
36.6K
Growth Rate:
75.56%
Total runs:
44.0K
Run Growth:
12.6K
Growth Rate:
28.60%
Total runs:
41.6K
Run Growth:
-11.8K
Growth Rate:
-28.43%
Total runs:
41.4K
Run Growth:
9.3K
Growth Rate:
22.52%
Total runs:
39.0K
Run Growth:
18.9K
Growth Rate:
48.35%
Total runs:
38.9K
Run Growth:
-21.0K
Growth Rate:
-53.94%
Total runs:
38.1K
Run Growth:
37.9K
Growth Rate:
100.00%
Total runs:
33.0K
Run Growth:
-1.3K
Growth Rate:
-3.81%
Total runs:
32.4K
Run Growth:
7.3K
Growth Rate:
22.42%
Total runs:
31.7K
Run Growth:
-8.8K
Growth Rate:
-28.27%
Total runs:
31.0K
Run Growth:
-8.1K
Growth Rate:
-26.25%
Total runs:
31.0K
Run Growth:
-6.9K
Growth Rate:
-22.33%
Total runs:
30.3K
Run Growth:
11.2K
Growth Rate:
37.08%
Total runs:
28.8K
Run Growth:
-9.2K
Growth Rate:
-31.92%
Total runs:
24.3K
Run Growth:
21.2K
Growth Rate:
87.28%