Total runs:
4.4M
Run Growth:
-814.8K
Growth Rate:
-18.87%
Sponsored by
YouArt
microsoft / xclip-base-patch32-16-frames
Model's Last Updated: October 28 2024
video-classification
Introduction of xclip-base-patch32-16-frames
Model Details of xclip-base-patch32-16-frames
X-CLIP (base-sized model)
X-CLIP model (base-sized, patch resolution of 32) trained fully-supervised on Kinetics-400 . It was introduced in the paper Expanding Language-Image Pretrained Models for General Video Recognition by Ni et al. and first released in this repository .
This model was trained using 16 frames per video, at a resolution of 224x224.
Disclaimer: The team releasing X-CLIP did not write a model card for this model so this model card has been written by the Hugging Face team.
Model description
X-CLIP is a minimal extension of CLIP for general video-language understanding. The model is trained in a contrastive way on (video, text) pairs.
This allows the model to be used for tasks like zero-shot, few-shot or fully supervised video classification and video-text retrieval.
Intended uses & limitations
You can use the raw model for determining how well text goes with a given video. See the model hub to look for fine-tuned versions on a task that interests you.
How to use
For code examples, we refer to the documentation .
Training data
This model was trained on Kinetics-400 .
Preprocessing
The exact details of preprocessing during training can be found here .
The exact details of preprocessing during validation can be found here .
During validation, one resizes the shorter edge of each frame, after which center cropping is performed to a fixed-size resolution (like 224x224). Next, frames are normalized across the RGB channels with the ImageNet mean and standard deviation.
Evaluation results
This model achieves a top-1 accuracy of 81.1% and a top-5 accuracy of 95.5%.
Runs of microsoft xclip-base-patch32-16-frames on huggingface.co
28.0K
Total runs
0
24-hour runs
19
3-day runs
-821
7-day runs
10.5K
30-day runs
More Information About xclip-base-patch32-16-frames huggingface.co Model
Url of xclip-base-patch32-16-frames
xclip-base-patch32-16-frames huggingface.co Url
Provider of xclip-base-patch32-16-frames huggingface.co
Other API from microsoft
Updated:April 06 2023
Total runs:
2.9M
Run Growth:
384.4K
Growth Rate:
13.08%
Total runs:
2.8M
Run Growth:
201.9K
Growth Rate:
7.21%
Total runs:
2.8M
Run Growth:
1.0M
Growth Rate:
37.74%
Total runs:
1.4M
Run Growth:
-594.8K
Growth Rate:
-43.39%
Total runs:
1.3M
Run Growth:
37.6K
Growth Rate:
2.83%
Total runs:
1.3M
Run Growth:
395.7K
Growth Rate:
31.12%
Total runs:
1.2M
Run Growth:
-63.5K
Growth Rate:
-5.41%
Total runs:
1.1M
Run Growth:
-157.5K
Growth Rate:
-13.89%
Total runs:
875.2K
Run Growth:
39.4K
Growth Rate:
4.50%
Total runs:
838.5K
Run Growth:
-286.4K
Growth Rate:
-34.15%
Total runs:
782.2K
Run Growth:
35.4K
Growth Rate:
4.53%
Total runs:
714.2K
Run Growth:
69.7K
Growth Rate:
9.86%
Total runs:
681.1K
Run Growth:
208.0K
Growth Rate:
30.53%
Total runs:
643.3K
Run Growth:
50.5K
Growth Rate:
7.85%
Total runs:
633.3K
Run Growth:
-227.5K
Growth Rate:
-35.92%
Total runs:
626.3K
Run Growth:
-397.4K
Growth Rate:
-63.45%
Total runs:
619.7K
Run Growth:
-66.5K
Growth Rate:
-10.77%
Total runs:
609.9K
Run Growth:
241.2K
Growth Rate:
39.54%
Total runs:
595.8K
Run Growth:
-131.1K
Growth Rate:
-22.00%
Total runs:
515.5K
Run Growth:
685.5K
Growth Rate:
81.33%
Total runs:
511.8K
Run Growth:
-531.5K
Growth Rate:
-103.84%
Total runs:
457.7K
Run Growth:
31.6K
Growth Rate:
6.85%
Total runs:
445.3K
Run Growth:
-148.1K
Growth Rate:
-31.90%
Total runs:
435.8K
Run Growth:
80.2K
Growth Rate:
17.72%
Total runs:
417.7K
Run Growth:
169.8K
Growth Rate:
40.65%
Total runs:
413.2K
Run Growth:
26.9K
Growth Rate:
6.51%
Total runs:
380.5K
Run Growth:
362.4K
Growth Rate:
95.24%
Total runs:
350.9K
Run Growth:
-670.4K
Growth Rate:
-191.05%
Total runs:
316.8K
Run Growth:
-151.7K
Growth Rate:
-47.04%
Total runs:
300.7K
Run Growth:
-36.4K
Growth Rate:
-12.10%
Total runs:
293.2K
Run Growth:
64.8K
Growth Rate:
22.11%
Total runs:
289.1K
Run Growth:
-22.3K
Growth Rate:
-7.70%
Total runs:
280.0K
Run Growth:
54.1K
Growth Rate:
20.48%
Total runs:
254.5K
Run Growth:
142.7K
Growth Rate:
56.04%
Total runs:
243.1K
Run Growth:
57.8K
Growth Rate:
23.51%
Total runs:
234.9K
Run Growth:
-311.3K
Growth Rate:
-132.50%
Total runs:
230.6K
Run Growth:
-26.8K
Growth Rate:
-11.64%
Total runs:
225.5K
Run Growth:
-304.3K
Growth Rate:
-138.30%
Total runs:
223.6K
Run Growth:
-59.6K
Growth Rate:
-26.65%
Total runs:
221.1K
Run Growth:
-9.9K
Growth Rate:
-4.40%
Total runs:
220.6K
Run Growth:
-460.1K
Growth Rate:
-184.74%
Total runs:
214.1K
Run Growth:
-28.1K
Growth Rate:
-13.14%
Total runs:
205.4K
Run Growth:
34.3K
Growth Rate:
16.71%
Total runs:
180.1K
Run Growth:
24.8K
Growth Rate:
13.77%
Total runs:
178.2K
Run Growth:
93.6K
Growth Rate:
52.50%
Total runs:
170.4K
Run Growth:
-34.9K
Growth Rate:
-20.61%
Total runs:
168.6K
Run Growth:
10.2K
Growth Rate:
6.07%
Total runs:
166.9K
Run Growth:
-401.8K
Growth Rate:
-240.68%
Total runs:
159.2K
Run Growth:
-46
Growth Rate:
-0.03%
Total runs:
140.1K
Run Growth:
7.5K
Growth Rate:
5.31%
Total runs:
139.6K
Run Growth:
68.9K
Growth Rate:
49.38%
Total runs:
136.2K
Run Growth:
-216.6K
Growth Rate:
-159.09%
Total runs:
133.1K
Run Growth:
-30.2K
Growth Rate:
-20.83%
Total runs:
123.4K
Run Growth:
13.0K
Growth Rate:
10.56%
Total runs:
119.0K
Run Growth:
15.7K
Growth Rate:
10.49%
Total runs:
117.8K
Run Growth:
-147.4K
Growth Rate:
-125.12%
Total runs:
117.6K
Run Growth:
-1.2K
Growth Rate:
-1.03%
Total runs:
117.3K
Run Growth:
1.2K
Growth Rate:
1.00%
Total runs:
115.8K
Run Growth:
75.8K
Growth Rate:
68.01%
Total runs:
104.6K
Run Growth:
3.8K
Growth Rate:
3.59%
Total runs:
102.0K
Run Growth:
13.3K
Growth Rate:
13.63%
Total runs:
100.5K
Run Growth:
54.7K
Growth Rate:
54.46%
Total runs:
95.5K
Run Growth:
91.6K
Growth Rate:
95.88%
Total runs:
92.4K
Run Growth:
-15.5K
Growth Rate:
-16.80%
Total runs:
88.0K
Run Growth:
-12.2K
Growth Rate:
-14.16%
Total runs:
80.8K
Run Growth:
14.3K
Growth Rate:
17.65%
Total runs:
72.4K
Run Growth:
-96.9K
Growth Rate:
-137.54%
Total runs:
70.7K
Run Growth:
8.3K
Growth Rate:
11.73%
Total runs:
69.7K
Run Growth:
-13.1K
Growth Rate:
-18.74%
Total runs:
68.7K
Run Growth:
-18.2K
Growth Rate:
-26.47%
Total runs:
62.8K
Run Growth:
-94.3K
Growth Rate:
-150.13%
Total runs:
62.4K
Run Growth:
20.0K
Growth Rate:
32.09%
Total runs:
57.5K
Run Growth:
26.0K
Growth Rate:
50.00%
Total runs:
53.8K
Run Growth:
-10.4K
Growth Rate:
-19.26%
Total runs:
53.0K
Run Growth:
-48.6K
Growth Rate:
-93.90%
Total runs:
48.0K
Run Growth:
9.2K
Growth Rate:
19.20%
Total runs:
46.4K
Run Growth:
15.4K
Growth Rate:
33.16%
Total runs:
45.8K
Run Growth:
881
Growth Rate:
1.92%
Total runs:
45.4K
Run Growth:
6.2K
Growth Rate:
13.57%
Total runs:
42.8K
Run Growth:
21.5K
Growth Rate:
50.09%
Total runs:
38.6K
Run Growth:
5.3K
Growth Rate:
14.82%
Total runs:
35.1K
Run Growth:
-9.1K
Growth Rate:
-25.79%
Total runs:
35.0K
Run Growth:
5.2K
Growth Rate:
14.85%
Total runs:
32.9K
Run Growth:
1.7K
Growth Rate:
5.15%
Total runs:
30.7K
Run Growth:
-3.3K
Growth Rate:
-10.74%
Total runs:
30.7K
Run Growth:
-133.4K
Growth Rate:
-402.11%
Total runs:
29.1K
Run Growth:
20.4K
Growth Rate:
80.56%
Total runs:
28.8K
Run Growth:
-13.8K
Growth Rate:
-48.00%
Total runs:
27.2K
Run Growth:
1.6K
Growth Rate:
5.89%
Total runs:
24.5K
Run Growth:
6.9K
Growth Rate:
28.12%
Total runs:
23.3K
Run Growth:
9.4K
Growth Rate:
40.23%