Total runs:
51.7K
Run Growth:
-3.0K
Growth Rate:
-5.71%
Sponsored by
APIMart
Vikhrmodels / Borealis
Model's Last Updated: September 18 2025
automatic-speech-recognition
Introduction of Borealis
Model Details of Borealis
Borealis
Описание
Borealis
- это наша первая audio llm c ASR для русского языка. В этом репозитории представлен чекпоинт, который видел примерно
7000
часов аудио на русском языке. Важным отличием от других моделей является то, что тут есть поддержка пунктуации в распознанных аудио. Архитектура во многом вдохновлена
Voxtral
, но отличается в некоторых моментах.
Использование
from transformers import AutoModelForCausalLM, AutoTokenizer, AutoFeatureExtractor
import torch
import librosa
model = AutoModelForCausalLM.from_pretrained("Vikhrmodels/Borealis", trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained("Vikhrmodels/Borealis")
extractor = AutoFeatureExtractor.from_pretrained("Vikhrmodels/Borealis")
generation_params = {
"max_new_tokens": 350,
"do_sample": True,
"top_p": 0.9,
"top_k": 50,
"temperature": 0.2,
}
model.eval()
model.to("cuda")
waveform, sr = librosa.load("path/to/your/audio.wav", sr=16_000)
proc = extractor(
waveform,
sampling_rate=sr,
padding="max_length",
max_length=480_000,
return_attention_mask=True,
return_tensors="pt",
)
mel = proc.input_features.squeeze(0).to("cuda")
att_mask = proc.attention_mask.squeeze(0).to("cuda")
with torch.inference_mode():
transcript = model.generate(mel=mel, att_mask=att_mask, **generation_params)
print(transcript)
Метрики модели
Ниже представлены замеры
Borealis
на фоне остальных открытых моделей, который поддерживают русский язык. Бенчмарк мы скоро выложим в открытый доступ
| Модель | Средний WER | RuLS | CV 22.0 | Books | Speak | Sova |
|---|---|---|---|---|---|---|
| Borealis | 6.33% | 6.39% | 2.67% | 5.28% | 1.95% | 15.37% |
| GigaAM-ASR-V2-RNNT | 5.85% | 5.24% | 2.85% | 8.06% | 3.08% | 10.01% |
| openai/whisper-large-v3 | 10.74% | 11.62% | 7.51% | 12.19% | 2.74% | 19.65% |
| bond005/whisper-podlodka-turbo | 9.38% | 11.91% | 6.36% | 8.96% | 3.14% | 16.55% |
| openai/whisper-large-v3-turbo | 11.30% | 11.88% | 8.17% | 13.29% | 2.80% | 20.37% |
| bond005/whisper-large-v3-ru-podlodka | 10.76% | 10.24% | 7.80% | 10.31% | 3.23% | 22.21% |
| nvidia/canary-1b-v2 | 13.52% | 20.16% | 9.12% | 11.45% | 4.97% | 21.89% |
| VOSK-model-ru-0.42 | 11.30% | 12.06% | 11.87% | 10.80% | 2.61% | 19.15% |
| GigaAM-ASR-V2-CTC | 6.45% | 5.26% | 3.42% | 7.72% | 3.01% | 12.86% |
Авторы
- Илья Кулешов, Vikhr Team
- Александр Николич, Vikhr Team
Runs of Vikhrmodels Borealis on huggingface.co
77.0K
Total runs
49
24-hour runs
191
3-day runs
329
7-day runs
76.7K
30-day runs
More Information About Borealis huggingface.co Model
Url of Borealis
Borealis huggingface.co Url
Provider of Borealis huggingface.co
Other API from Vikhrmodels
Updated:October 25 2024
Total runs:
15.3K
Run Growth:
-3.2K
Growth Rate:
-20.65%
Total runs:
3.9K
Run Growth:
-10
Growth Rate:
-0.26%
Total runs:
1.9K
Run Growth:
154
Growth Rate:
8.70%
Total runs:
1.4K
Run Growth:
-46.4K
Growth Rate:
-3265.77%
Total runs:
1.1K
Run Growth:
-172
Growth Rate:
-15.57%
Total runs:
879
Run Growth:
705
Growth Rate:
80.20%
Total runs:
865
Run Growth:
173
Growth Rate:
20.00%
Total runs:
829
Run Growth:
-50
Growth Rate:
-6.03%
Total runs:
611
Run Growth:
434
Growth Rate:
71.03%
Total runs:
526
Run Growth:
-127
Growth Rate:
-24.14%
Total runs:
507
Run Growth:
38
Growth Rate:
7.50%
Total runs:
471
Run Growth:
113
Growth Rate:
23.99%
Total runs:
459
Run Growth:
-124
Growth Rate:
-27.02%
Total runs:
443
Run Growth:
55
Growth Rate:
12.42%
Total runs:
427
Run Growth:
-534
Growth Rate:
-125.06%
Total runs:
358
Run Growth:
145
Growth Rate:
40.50%
Total runs:
292
Run Growth:
14
Growth Rate:
4.79%
Total runs:
253
Run Growth:
211
Growth Rate:
83.40%
Total runs:
250
Run Growth:
-183
Growth Rate:
-73.20%
Total runs:
241
Run Growth:
11
Growth Rate:
4.56%
Total runs:
236
Run Growth:
-64
Growth Rate:
-27.12%
Total runs:
163
Run Growth:
-746
Growth Rate:
-457.67%
Total runs:
162
Run Growth:
-36
Growth Rate:
-22.22%
Total runs:
121
Run Growth:
-63
Growth Rate:
-52.07%
Total runs:
107
Run Growth:
70
Growth Rate:
65.42%
Total runs:
105
Run Growth:
-6
Growth Rate:
-5.71%
Total runs:
103
Run Growth:
69
Growth Rate:
66.99%
Total runs:
102
Run Growth:
69
Growth Rate:
67.65%
Total runs:
102
Run Growth:
-25
Growth Rate:
-24.51%
Total runs:
102
Run Growth:
-810
Growth Rate:
-794.12%
Total runs:
95
Run Growth:
76
Growth Rate:
80.00%
Total runs:
94
Run Growth:
55
Growth Rate:
58.51%
Total runs:
91
Run Growth:
-25
Growth Rate:
-27.47%
Total runs:
85
Run Growth:
52
Growth Rate:
61.18%
Total runs:
85
Run Growth:
26
Growth Rate:
30.59%
Total runs:
84
Run Growth:
52
Growth Rate:
61.90%
Total runs:
84
Run Growth:
51
Growth Rate:
60.71%
Total runs:
83
Run Growth:
52
Growth Rate:
63.41%
Total runs:
83
Run Growth:
54
Growth Rate:
65.06%
Total runs:
81
Run Growth:
49
Growth Rate:
60.49%
Total runs:
81
Run Growth:
50
Growth Rate:
61.73%
Total runs:
80
Run Growth:
50
Growth Rate:
62.50%
Total runs:
80
Run Growth:
49
Growth Rate:
61.25%
Total runs:
77
Run Growth:
44
Growth Rate:
57.14%
Total runs:
77
Run Growth:
36
Growth Rate:
46.75%
Total runs:
74
Run Growth:
42
Growth Rate:
56.76%
Total runs:
73
Run Growth:
37
Growth Rate:
50.68%
Total runs:
72
Run Growth:
39
Growth Rate:
54.17%
Total runs:
71
Run Growth:
41
Growth Rate:
57.75%
Total runs:
67
Run Growth:
43
Growth Rate:
64.18%
Total runs:
61
Run Growth:
-26
Growth Rate:
-42.62%
Total runs:
61
Run Growth:
21
Growth Rate:
34.43%
Total runs:
52
Run Growth:
23
Growth Rate:
44.23%
Total runs:
42
Run Growth:
23
Growth Rate:
54.76%
Total runs:
39
Run Growth:
-63
Growth Rate:
-161.54%
Total runs:
29
Run Growth:
29
Growth Rate:
100.00%
Total runs:
27
Run Growth:
-1
Growth Rate:
-3.70%
Total runs:
26
Run Growth:
6
Growth Rate:
23.08%
Total runs:
25
Run Growth:
-2
Growth Rate:
-8.00%
Total runs:
25
Run Growth:
3
Growth Rate:
12.00%
Total runs:
24
Run Growth:
0
Growth Rate:
0.00%
Total runs:
23
Run Growth:
21
Growth Rate:
91.30%
Total runs:
20
Run Growth:
6
Growth Rate:
30.00%
Total runs:
20
Run Growth:
6
Growth Rate:
30.00%
Total runs:
19
Run Growth:
5
Growth Rate:
26.32%
Total runs:
14
Run Growth:
8
Growth Rate:
57.14%
Total runs:
14
Run Growth:
5
Growth Rate:
35.71%
Total runs:
13
Run Growth:
4
Growth Rate:
30.77%
Total runs:
12
Run Growth:
4
Growth Rate:
33.33%
Total runs:
12
Run Growth:
3
Growth Rate:
25.00%
Total runs:
11
Run Growth:
7
Growth Rate:
63.64%
Total runs:
10
Run Growth:
5
Growth Rate:
50.00%
Total runs:
9
Run Growth:
0
Growth Rate:
0.00%
Total runs:
9
Run Growth:
9
Growth Rate:
100.00%
Total runs:
9
Run Growth:
5
Growth Rate:
55.56%
Total runs:
8
Run Growth:
-14
Growth Rate:
-175.00%
Total runs:
8
Run Growth:
5
Growth Rate:
62.50%