Total runs:
2.6K
Run Growth:
453
Growth Rate:
18.15%
Sponsored by
YouArt
sil-ai / wav2vec2-bloom-speech-quc
Model's Last Updated: October 21 2022
automatic-speech-recognition
Introduction of wav2vec2-bloom-speech-quc
Model Details of wav2vec2-bloom-speech-quc
wav2vec2-bloom-speech-quc
Model description
- Homepage: SIL AI
- Point of Contact: SIL AI email
- Source Data: Bloom Library
This model is a fine-tuned version of facebook/wav2vec2-xls-r-300m on the SIL-AI/bloom-speech - QUC (K’iche’) dataset. It achieves the following results on the evaluation set:
- Loss: 0.7370
- Wer: 0.3508
- Cer: 0.1010
Users should refer to the original model for tutorials on using a trained model for inference.
Intended uses & limitations
Users of this model must abide by the SIL RAIL-M License .
This model is created as a proof of concept and no guarantees are made regarding the performance of the model is specific situations.
Training and evaluation data
Training, Validation, and Test datasets were generated from the same corpus, ensuring that no duplicate files were used.
Training procedure
Standard finetuning of XLS-R was used based on the examples in the Hugging Face Transformers Github
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0003
- train_batch_size: 16
- eval_batch_size: 8
- seed: 42
- gradient_accumulation_steps: 2
- total_train_batch_size: 32
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 250
- num_epochs: 1000.0
- mixed_precision_training: Native AMP
Training results
| Training Loss | Epoch | Step | Validation Loss | Wer | Cer |
|---|---|---|---|---|---|
| No log | 5.55 | 250 | 2.9144 | 1.0 | 1.0 |
| 4.7167 | 11.11 | 500 | 0.9985 | 0.8459 | 0.2448 |
| 4.7167 | 16.66 | 750 | 0.6897 | 0.4787 | 0.1236 |
| 0.482 | 22.22 | 1000 | 0.6056 | 0.3869 | 0.0998 |
| 0.482 | 27.77 | 1250 | 0.6202 | 0.3770 | 0.1040 |
| 0.2359 | 33.33 | 1500 | 0.6799 | 0.4 | 0.1052 |
| 0.2359 | 38.88 | 1750 | 0.7070 | 0.3574 | 0.1004 |
| 0.1668 | 44.44 | 2000 | 0.7370 | 0.3508 | 0.1010 |
| 0.1668 | 49.99 | 2250 | 0.7869 | 0.3803 | 0.1070 |
| 0.1334 | 55.55 | 2500 | 0.7652 | 0.3803 | 0.1034 |
| 0.1334 | 61.11 | 2750 | 0.7867 | 0.3574 | 0.1022 |
Framework versions
- Transformers 4.21.0.dev0
- Pytorch 1.9.0+cu111
- Datasets 2.2.2
- Tokenizers 0.12.1
Runs of sil-ai wav2vec2-bloom-speech-quc on huggingface.co
3
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
2
30-day runs
More Information About wav2vec2-bloom-speech-quc huggingface.co Model
Url of wav2vec2-bloom-speech-quc
wav2vec2-bloom-speech-quc huggingface.co Url
Provider of wav2vec2-bloom-speech-quc huggingface.co
Other API from sil-ai
Updated:October 21 2022
Total runs:
311
Run Growth:
-902
Growth Rate:
-290.03%
Total runs:
180
Run Growth:
180
Growth Rate:
100.00%
Total runs:
176
Run Growth:
176
Growth Rate:
100.00%
Total runs:
159
Run Growth:
8
Growth Rate:
5.03%
Total runs:
151
Run Growth:
3
Growth Rate:
1.99%
Total runs:
141
Run Growth:
3
Growth Rate:
2.13%
Total runs:
112
Run Growth:
0
Growth Rate:
0.00%
Total runs:
93
Run Growth:
93
Growth Rate:
100.00%
Total runs:
77
Run Growth:
-571
Growth Rate:
-741.56%
Total runs:
76
Run Growth:
76
Growth Rate:
100.00%
Total runs:
75
Run Growth:
73
Growth Rate:
97.33%
Total runs:
71
Run Growth:
71
Growth Rate:
100.00%
Total runs:
64
Run Growth:
64
Growth Rate:
100.00%
Total runs:
62
Run Growth:
0
Growth Rate:
0.00%
Total runs:
51
Run Growth:
2
Growth Rate:
3.92%
Total runs:
50
Run Growth:
40
Growth Rate:
80.00%
Total runs:
45
Run Growth:
0
Growth Rate:
0.00%
Total runs:
43
Run Growth:
41
Growth Rate:
95.35%
Total runs:
38
Run Growth:
0
Growth Rate:
0.00%
Total runs:
35
Run Growth:
0
Growth Rate:
0.00%
Total runs:
29
Run Growth:
0
Growth Rate:
0.00%
Total runs:
28
Run Growth:
0
Growth Rate:
0.00%
Total runs:
25
Run Growth:
18
Growth Rate:
72.00%
Total runs:
25
Run Growth:
0
Growth Rate:
0.00%
Total runs:
21
Run Growth:
0
Growth Rate:
0.00%
Total runs:
21
Run Growth:
0
Growth Rate:
0.00%
Total runs:
20
Run Growth:
0
Growth Rate:
0.00%
Total runs:
19
Run Growth:
0
Growth Rate:
0.00%
Total runs:
17
Run Growth:
0
Growth Rate:
0.00%
Total runs:
17
Run Growth:
0
Growth Rate:
0.00%
Total runs:
16
Run Growth:
0
Growth Rate:
0.00%
Total runs:
15
Run Growth:
-241
Growth Rate:
-1721.43%
Total runs:
14
Run Growth:
-48
Growth Rate:
-369.23%
Total runs:
14
Run Growth:
0
Growth Rate:
0.00%
Total runs:
13
Run Growth:
0
Growth Rate:
0.00%
Total runs:
13
Run Growth:
0
Growth Rate:
0.00%
Total runs:
12
Run Growth:
0
Growth Rate:
0.00%
Total runs:
12
Run Growth:
8
Growth Rate:
66.67%
Total runs:
12
Run Growth:
9
Growth Rate:
75.00%
Total runs:
12
Run Growth:
0
Growth Rate:
0.00%
Total runs:
11
Run Growth:
0
Growth Rate:
0.00%
Total runs:
10
Run Growth:
0
Growth Rate:
0.00%
Total runs:
10
Run Growth:
0
Growth Rate:
0.00%
Total runs:
10
Run Growth:
8
Growth Rate:
80.00%
Total runs:
10
Run Growth:
8
Growth Rate:
80.00%
Total runs:
9
Run Growth:
4
Growth Rate:
44.44%
Total runs:
9
Run Growth:
5
Growth Rate:
55.56%
Total runs:
9
Run Growth:
0
Growth Rate:
0.00%
Total runs:
9
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8
Run Growth:
4
Growth Rate:
50.00%
Total runs:
8
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8
Run Growth:
-243
Growth Rate:
-3037.50%
Total runs:
8
Run Growth:
0
Growth Rate:
0.00%
Total runs:
7
Run Growth:
-17
Growth Rate:
-242.86%
Total runs:
7
Run Growth:
4
Growth Rate:
57.14%
Total runs:
7
Run Growth:
6
Growth Rate:
85.71%
Total runs:
7
Run Growth:
5
Growth Rate:
71.43%
Total runs:
6
Run Growth:
6
Growth Rate:
100.00%
Total runs:
6
Run Growth:
-207
Growth Rate:
-3450.00%
Total runs:
6
Run Growth:
5
Growth Rate:
83.33%
Total runs:
6
Run Growth:
3
Growth Rate:
50.00%
Total runs:
5
Run Growth:
1
Growth Rate:
20.00%
Total runs:
5
Run Growth:
4
Growth Rate:
80.00%
Total runs:
5
Run Growth:
2
Growth Rate:
40.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
4
Growth Rate:
80.00%
Total runs:
5
Run Growth:
-98
Growth Rate:
-1960.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
4
Growth Rate:
80.00%
Total runs:
4
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
-3
Growth Rate:
-75.00%
Total runs:
4
Run Growth:
2
Growth Rate:
50.00%
Total runs:
4
Run Growth:
3
Growth Rate:
75.00%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
1
Growth Rate:
33.33%
Total runs:
3
Run Growth:
-2
Growth Rate:
-66.67%
Total runs:
3
Run Growth:
-206
Growth Rate:
-6866.67%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
-13
Growth Rate:
-433.33%
Total runs:
2
Run Growth:
-14
Growth Rate:
-700.00%