patrickvonplaten / wav2vec2-2-bart-large

huggingface.co
Total runs: 28
24-hour runs: 0
7-day runs: -1
30-day runs: 15
Model's Last Updated: December 29 2021
automatic-speech-recognition

Introduction of wav2vec2-2-bart-large

Model Details of wav2vec2-2-bart-large

To rerun this experiment, please clone this directory and run:

python create_model.py

followed by

./run_librispeech.sh

wav2vec2-2-bart-large

This model is a fine-tuned version of facebook/wav2vec2-large-lv60 and bart-large on the librispeech_asr - clean dataset.

It achieves the following results on the evaluation set:

  • Loss: 0.3204
  • Wer: 0.0486
Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure
Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 0.0003
  • train_batch_size: 4
  • eval_batch_size: 4
  • gradient_accumulation_steps: 2
  • seed: 42
  • distributed_type: multi-GPU
  • num_devices: 8
  • total_train_batch_size: 64
  • total_eval_batch_size: 64
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • lr_scheduler_warmup_steps: 500
  • num_epochs: 5
  • mixed_precision_training: Native AMP
Training results

See Training Metrics Tab.

Framework versions
  • Transformers 4.15.0.dev0
  • Pytorch 1.9.0+cu111
  • Datasets 1.16.2.dev0
  • Tokenizers 0.10.3

Runs of patrickvonplaten wav2vec2-2-bart-large on huggingface.co

28
Total runs
0
24-hour runs
-1
3-day runs
-1
7-day runs
15
30-day runs

More Information About wav2vec2-2-bart-large huggingface.co Model

wav2vec2-2-bart-large huggingface.co

wav2vec2-2-bart-large huggingface.co is an AI model on huggingface.co that provides wav2vec2-2-bart-large's model effect (), which can be used instantly with this patrickvonplaten wav2vec2-2-bart-large model. huggingface.co supports a free trial of the wav2vec2-2-bart-large model, and also provides paid use of the wav2vec2-2-bart-large. Support call wav2vec2-2-bart-large model through api, including Node.js, Python, http.

patrickvonplaten wav2vec2-2-bart-large online free

wav2vec2-2-bart-large huggingface.co is an online trial and call api platform, which integrates wav2vec2-2-bart-large's modeling effects, including api services, and provides a free online trial of wav2vec2-2-bart-large, you can try wav2vec2-2-bart-large online for free by clicking the link below.

patrickvonplaten wav2vec2-2-bart-large online free url in huggingface.co:

https://huggingface.co/patrickvonplaten/wav2vec2-2-bart-large

wav2vec2-2-bart-large install

wav2vec2-2-bart-large is an open source model from GitHub that offers a free installation service, and any user can find wav2vec2-2-bart-large on GitHub to install. At the same time, huggingface.co provides the effect of wav2vec2-2-bart-large install, users can directly use wav2vec2-2-bart-large installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

wav2vec2-2-bart-large install url in huggingface.co:

https://huggingface.co/patrickvonplaten/wav2vec2-2-bart-large

Url of wav2vec2-2-bart-large

Provider of wav2vec2-2-bart-large huggingface.co

patrickvonplaten
ORGANIZATIONS

Other API from patrickvonplaten