Total runs:
8.3M
Run Growth:
-9.0M
Growth Rate:
-107.03%
Sponsored by
YouArt
facebook / wav2vec2-xls-r-1b
Model's Last Updated: August 10 2022
Introduction of wav2vec2-xls-r-1b
Model Details of wav2vec2-xls-r-1b
Wav2Vec2-XLS-R-1B
Facebook's Wav2Vec2 XLS-R counting 1 billion parameters.
XLS-R is Facebook AI's large-scale multilingual pretrained model for speech (the "XLM-R for Speech"). It is pretrained on 436k hours of unlabeled speech, including VoxPopuli, MLS, CommonVoice, BABEL, and VoxLingua107. It uses the wav2vec 2.0 objective, in 128 languages. When using the model make sure that your speech input is sampled at 16kHz.
Note : This model should be fine-tuned on a downstream task, like Automatic Speech Recognition, Translation, or Classification. Check out this blog for more information about ASR.
Abstract This paper presents XLS-R, a large-scale model for cross-lingual speech representation learning based on wav2vec 2.0. We train models with up to 2B parameters on 436K hours of publicly available speech audio in 128 languages, an order of magnitude more public data than the largest known prior work. Our evaluation covers a wide range of tasks, domains, data regimes and languages, both high and low-resource. On the CoVoST-2 speech translation benchmark, we improve the previous state of the art by an average of 7.4 BLEU over 21 translation directions into English. For speech recognition, XLS-R improves over the best known prior work on BABEL, MLS, CommonVoice as well as VoxPopuli, lowering error rates by 20%-33% relative on average. XLS-R also sets a new state of the art on VoxLingua107 language identification. Moreover, we show that with sufficient model size, cross-lingual pretraining can outperform English-only pretraining when translating English speech into other languages, a setting which favors monolingual pretraining. We hope XLS-R can help to improve speech processing tasks for many more languages of the world.
The original model can be found under https://github.com/pytorch/fairseq/tree/master/examples/wav2vec#wav2vec-20 .
Usage
See this google colab for more information on how to fine-tune the model.
You can find other pretrained XLS-R models with different numbers of parameters:
Runs of facebook wav2vec2-xls-r-1b on huggingface.co
54.3K
Total runs
0
24-hour runs
0
3-day runs
6.5K
7-day runs
44.7K
30-day runs
More Information About wav2vec2-xls-r-1b huggingface.co Model
Url of wav2vec2-xls-r-1b
wav2vec2-xls-r-1b huggingface.co Url
Provider of wav2vec2-xls-r-1b huggingface.co
Other API from facebook
Updated:September 15 2023
Total runs:
4.0M
Run Growth:
-137.2K
Growth Rate:
-3.32%
Total runs:
3.2M
Run Growth:
997.1K
Growth Rate:
30.98%
Total runs:
3.2M
Run Growth:
234.2K
Growth Rate:
7.11%
Total runs:
2.8M
Run Growth:
-507.9K
Growth Rate:
-18.04%
Total runs:
2.3M
Run Growth:
847.1K
Growth Rate:
36.55%
Total runs:
1.9M
Run Growth:
45.5K
Growth Rate:
2.34%
Total runs:
1.4M
Run Growth:
-372.8K
Growth Rate:
-27.22%
Total runs:
1.3M
Run Growth:
140.8K
Growth Rate:
10.21%
Total runs:
1.3M
Run Growth:
-193.7K
Growth Rate:
-14.94%
Total runs:
1.3M
Run Growth:
-1.1M
Growth Rate:
-87.91%
Total runs:
712.7K
Run Growth:
38.2K
Growth Rate:
5.36%
Total runs:
696.7K
Run Growth:
-225.4K
Growth Rate:
-32.23%
Total runs:
672.0K
Run Growth:
334.1K
Growth Rate:
49.16%
Total runs:
631.1K
Run Growth:
-123.1K
Growth Rate:
-22.27%
Total runs:
616.5K
Run Growth:
-1.7M
Growth Rate:
-273.96%
Total runs:
597.9K
Run Growth:
-19.8K
Growth Rate:
-3.31%
Total runs:
582.7K
Run Growth:
148.9K
Growth Rate:
25.81%
Total runs:
522.9K
Run Growth:
54.0K
Growth Rate:
10.35%
Total runs:
483.5K
Run Growth:
-117.9K
Growth Rate:
-24.39%
Total runs:
452.9K
Run Growth:
95.8K
Growth Rate:
21.32%
Total runs:
441.6K
Run Growth:
70.8K
Growth Rate:
16.61%
Total runs:
439.8K
Run Growth:
61.2K
Growth Rate:
13.92%
Total runs:
416.2K
Run Growth:
-121.6K
Growth Rate:
-28.61%
Total runs:
389.2K
Run Growth:
-81.7K
Growth Rate:
-21.21%
Total runs:
375.1K
Run Growth:
221.2K
Growth Rate:
61.41%
Total runs:
358.3K
Run Growth:
-46.6K
Growth Rate:
-12.80%
Total runs:
318.1K
Run Growth:
-34.5K
Growth Rate:
-10.84%
Total runs:
314.3K
Run Growth:
-19.8K
Growth Rate:
-6.07%
Total runs:
313.7K
Run Growth:
35.6K
Growth Rate:
11.28%
Total runs:
308.8K
Run Growth:
-9.4K
Growth Rate:
-3.09%
Total runs:
302.6K
Run Growth:
-21.6K
Growth Rate:
-7.14%
Total runs:
297.9K
Run Growth:
-185.1K
Growth Rate:
-60.45%
Total runs:
279.0K
Run Growth:
8.7K
Growth Rate:
3.10%
Total runs:
234.4K
Run Growth:
-9.4K
Growth Rate:
-3.86%
Total runs:
226.6K
Run Growth:
55.9K
Growth Rate:
26.21%
Total runs:
219.1K
Run Growth:
113.7K
Growth Rate:
51.91%
Total runs:
218.6K
Run Growth:
-133.6K
Growth Rate:
-58.12%
Total runs:
216.1K
Run Growth:
-72.4K
Growth Rate:
-30.92%
Total runs:
199.1K
Run Growth:
28.2K
Growth Rate:
14.00%
Total runs:
192.2K
Run Growth:
-5.0K
Growth Rate:
-2.75%
Total runs:
190.3K
Run Growth:
111.7K
Growth Rate:
57.72%
Total runs:
188.1K
Run Growth:
-85.5K
Growth Rate:
-45.08%
Total runs:
176.5K
Run Growth:
67.9K
Growth Rate:
40.58%
Total runs:
173.6K
Run Growth:
-235.8K
Growth Rate:
-137.83%
Total runs:
167.5K
Run Growth:
-309.1K
Growth Rate:
-178.16%
Total runs:
163.1K
Run Growth:
6.0K
Growth Rate:
3.67%
Total runs:
150.4K
Run Growth:
87.0K
Growth Rate:
53.24%
Total runs:
149.8K
Run Growth:
39.2K
Growth Rate:
24.92%
Total runs:
149.6K
Run Growth:
7.3K
Growth Rate:
4.95%
Total runs:
149.2K
Run Growth:
132.6K
Growth Rate:
87.56%
Total runs:
144.1K
Run Growth:
92.5K
Growth Rate:
60.10%
Total runs:
141.8K
Run Growth:
28.5K
Growth Rate:
21.15%
Total runs:
125.5K
Run Growth:
23.8K
Growth Rate:
19.32%
Total runs:
114.6K
Run Growth:
2.3K
Growth Rate:
2.02%
Total runs:
111.8K
Run Growth:
-16.1K
Growth Rate:
-15.73%
Total runs:
111.1K
Run Growth:
26.3K
Growth Rate:
23.03%
Total runs:
110.9K
Run Growth:
16.2K
Growth Rate:
15.89%
Total runs:
107.0K
Run Growth:
22.1K
Growth Rate:
21.28%
Total runs:
107.0K
Run Growth:
19.4K
Growth Rate:
18.62%
Total runs:
104.9K
Run Growth:
45.3K
Growth Rate:
43.18%
Total runs:
102.3K
Run Growth:
18.7K
Growth Rate:
18.83%
Total runs:
96.7K
Run Growth:
-69.1K
Growth Rate:
-78.20%
Total runs:
96.6K
Run Growth:
-212.3K
Growth Rate:
-201.98%
Total runs:
96.3K
Run Growth:
15.5K
Growth Rate:
17.56%
Total runs:
89.4K
Run Growth:
-762
Growth Rate:
-0.85%
Total runs:
84.5K
Run Growth:
79.6K
Growth Rate:
97.44%
Total runs:
84.3K
Run Growth:
43.5K
Growth Rate:
65.57%
Total runs:
83.1K
Run Growth:
35.0K
Growth Rate:
44.61%
Total runs:
81.7K
Run Growth:
36.0K
Growth Rate:
50.22%
Total runs:
79.4K
Run Growth:
-43.9K
Growth Rate:
-55.24%
Total runs:
77.4K
Run Growth:
55.8K
Growth Rate:
74.72%
Total runs:
75.1K
Run Growth:
-2.9K
Growth Rate:
-3.73%
Total runs:
74.3K
Run Growth:
7.5K
Growth Rate:
9.90%
Total runs:
73.8K
Run Growth:
24.3K
Growth Rate:
33.97%
Total runs:
68.4K
Run Growth:
12.0K
Growth Rate:
17.51%
Total runs:
66.3K
Run Growth:
14.4K
Growth Rate:
23.08%
Total runs:
63.7K
Run Growth:
56.0K
Growth Rate:
72.29%
Total runs:
62.3K
Run Growth:
-46.5K
Growth Rate:
-80.83%
Total runs:
60.1K
Run Growth:
-176.2K
Growth Rate:
-293.29%
Total runs:
55.2K
Run Growth:
-14.7K
Growth Rate:
-26.55%
Total runs:
53.1K
Run Growth:
32.7K
Growth Rate:
54.09%
Total runs:
52.1K
Run Growth:
2.2K
Growth Rate:
4.17%
Total runs:
51.7K
Run Growth:
-13.9K
Growth Rate:
-26.25%