Multilingual Distilwhisper allows for better ASR performance in target languages by adding lightweight CLSR modules on top of whisper-small.
These modules are trained on a mix of cross-entropy (ASR) and knowledge distillation losses, where whisper-large-v2 is used as teacher.
@inproceedings{ferraz2024distilwhisper,
title={Multilingual DistilWhisper: Efficient Distillation of Multi-task Speech Models via Language-Specific Experts},
author={Ferraz, Thomas Palmeira and Boito, Marcely Zanon and Brun, Caroline and Nikoulina, Vassilina},
booktitle={ICASSP 2024-2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)},
year={2024},
organization={IEEE}
}
Runs of naver multilingual-distilwhisper-28k on huggingface.co
10
Total runs
0
24-hour runs
2
3-day runs
1
7-day runs
3
30-day runs
More Information About multilingual-distilwhisper-28k huggingface.co Model
More multilingual-distilwhisper-28k license Visit here:
multilingual-distilwhisper-28k huggingface.co is an AI model on huggingface.co that provides multilingual-distilwhisper-28k's model effect (), which can be used instantly with this naver multilingual-distilwhisper-28k model. huggingface.co supports a free trial of the multilingual-distilwhisper-28k model, and also provides paid use of the multilingual-distilwhisper-28k. Support call multilingual-distilwhisper-28k model through api, including Node.js, Python, http.
multilingual-distilwhisper-28k huggingface.co is an online trial and call api platform, which integrates multilingual-distilwhisper-28k's modeling effects, including api services, and provides a free online trial of multilingual-distilwhisper-28k, you can try multilingual-distilwhisper-28k online for free by clicking the link below.
naver multilingual-distilwhisper-28k online free url in huggingface.co:
multilingual-distilwhisper-28k is an open source model from GitHub that offers a free installation service, and any user can find multilingual-distilwhisper-28k on GitHub to install. At the same time, huggingface.co provides the effect of multilingual-distilwhisper-28k install, users can directly use multilingual-distilwhisper-28k installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
multilingual-distilwhisper-28k install url in huggingface.co: