Total runs:
4.7M
Run Growth:
-449.0K
Growth Rate:
-9.59%
Sponsored by
Agentkit
microsoft / VibeVoice-ASR-BitNet
Model's Last Updated: July 24 2026
automatic-speech-recognition
Introduction of VibeVoice-ASR-BitNet
Model Details of VibeVoice-ASR-BitNet
VibeVoice-ASR-BitNet
VibeVoice-ASR-BitNet is a compressed variant of VibeVoice-ASR optimized for real-time inference on edge CPUs — no GPU required. Through heterogeneous quantization, the model is compressed from 4.62 GB to 1.58 GB while achieving 1.6–2.3× faster inference than Whisper.cpp with real-time capability (RTF < 1) on as few as 3 CPU threads.
➡️
Code:
microsoft/VibeASR.cpp
➡️
Report:
VibeVoice-ASR-BitNet Technical Report
➡️
Base Model:
microsoft/VibeVoice-ASR
🔥 Key Features
- ⚡ Real-time on CPU — RTF < 1 with 3+ threads on commodity x86 (AVX2) and ARM (NEON) hardware
- 📦 Compact — 1.58 GB total (2.9× compression from FP16), fits in edge device memory
- 🌍 Multilingual — English, Chinese, French, Italian, Korean, Portuguese, Vietnamese, and more
- 🔧 Custom SIMD Kernels — Fused operators within the ggml framework for both ARM and x86 platforms
Quantization Strategy
| Component | FP16 | Quantized | Method | Compression |
|---|---|---|---|---|
| VAE Tokenizer | 1.31 GB | 0.65 GB | I8_S | 2.0× |
| LM Decoder | 3.32 GB | 0.92 GB | I2_S + Q6_K | 3.6× |
| Total | 4.62 GB | 1.58 GB | — | 2.9× |
Evaluation
Inference Speed
| Threads | 1 | 2 | 3 | 4 | 6 | 8 |
|---|---|---|---|---|---|---|
| RTF | 1.98 | 1.08 | 0.77 | 0.63 | 0.49 | 0.42 |
| vs. Whisper.cpp | 2.28× | 2.12× | 1.86× | 1.86× | 1.71× | 1.55× |
Benchmarked on AMD EPYC 7V13 (AVX2+FMA) with 20s audio. Bold = RTF < 1 (real-time).
Accuracy (WER%)
| Benchmark | VibeVoice-ASR-7B | VibeVoice-ASR-BitNet | Parakeet | Whisper | SenseVoice | FunASR |
|---|---|---|---|---|---|---|
| MLC-EN | 7.82 | 8.25 | 8.40 | 13.57 | 12.39 | 11.36 |
| MLC-FR | 16.03 | 17.41 | — | — | — | — |
| MLC-IT | 15.67 | 17.23 | — | — | — | — |
| MLC-KO | 9.83 | 11.15 | — | — | — | — |
| MLC-PT | 22.41 | 24.87 | — | — | — | — |
| MLC-VI | 20.15 | 22.38 | — | — | — | — |
| AISHELL4 | 19.83 | 27.45 | — | — | 22.52 | 20.41 |
| AMI-ihm | 17.42 | 21.36 | 21.92 | 27.07 | 30.81 | 32.07 |
| AMI-sdm | 24.18 | 25.87 | 26.33 | 36.92 | 48.11 | 40.17 |
| AliMeeting | 36.21 | 40.58 | — | — | 38.75 | 39.27 |
| Fleurs-en | 4.73 | 5.21 | 4.09 | 3.99 | 6.84 | 4.93 |
| Fleurs-zh | 7.92 | 8.35 | — | — | 5.56 | 7.00 |
| Libri-clean | 2.17 | 2.41 | 1.49 | 1.98 | 2.78 | 1.58 |
| Libri-other | 5.84 | 6.27 | 3.13 | 3.60 | 6.81 | 4.01 |
| VoxPopuli | 4.92 | 5.18 | 5.26 | 7.19 | 8.63 | 6.46 |
Model Files
| File | Size | Description |
|---|---|---|
vibeasr-vae-encoder-i8_s.gguf
|
0.65 GB | VAE tokenizer, I8_S quantized (ready to use) |
vibeasr-lm-i2_s-embed-q6_k.gguf
|
0.92 GB | LM decoder, I2_S quantized (ready to use) |
model-*.safetensors
|
10.7 GB | Original SafeTensors (for conversion) |
License
This project is licensed under the MIT License.
Contact
This project was conducted by members of Microsoft Research. If you have suggestions, questions, or observe unexpected behavior, please contact us at [email protected] .
Runs of microsoft VibeVoice-ASR-BitNet on huggingface.co
22.4K
Total runs
3.0K
24-hour runs
6.8K
3-day runs
9.5K
7-day runs
6.4K
30-day runs
More Information About VibeVoice-ASR-BitNet huggingface.co Model
Url of VibeVoice-ASR-BitNet
VibeVoice-ASR-BitNet huggingface.co Url
Provider of VibeVoice-ASR-BitNet huggingface.co
Other API from microsoft
Updated:April 06 2023
Total runs:
3.0M
Run Growth:
126.0K
Growth Rate:
4.28%
Total runs:
2.9M
Run Growth:
85.4K
Growth Rate:
2.94%
Total runs:
2.8M
Run Growth:
909.0K
Growth Rate:
32.72%
Total runs:
1.3M
Run Growth:
37.6K
Growth Rate:
2.83%
Total runs:
1.3M
Run Growth:
314.7K
Growth Rate:
24.79%
Total runs:
1.2M
Run Growth:
-854.1K
Growth Rate:
-70.13%
Total runs:
1.2M
Run Growth:
-63.5K
Growth Rate:
-5.41%
Total runs:
1.1M
Run Growth:
-157.5K
Growth Rate:
-13.89%
Total runs:
875.2K
Run Growth:
39.4K
Growth Rate:
4.50%
Total runs:
838.5K
Run Growth:
-286.4K
Growth Rate:
-34.15%
Total runs:
782.2K
Run Growth:
35.4K
Growth Rate:
4.53%
Total runs:
720.0K
Run Growth:
23.3K
Growth Rate:
3.24%
Total runs:
681.1K
Run Growth:
208.0K
Growth Rate:
30.53%
Total runs:
665.2K
Run Growth:
-249.0K
Growth Rate:
-37.43%
Total runs:
659.8K
Run Growth:
-279.3K
Growth Rate:
-42.34%
Total runs:
643.3K
Run Growth:
50.5K
Growth Rate:
7.85%
Total runs:
609.9K
Run Growth:
241.2K
Growth Rate:
39.54%
Total runs:
608.7K
Run Growth:
-94.8K
Growth Rate:
-15.54%
Total runs:
595.8K
Run Growth:
-131.1K
Growth Rate:
-22.00%
Total runs:
511.8K
Run Growth:
-531.5K
Growth Rate:
-103.84%
Total runs:
457.7K
Run Growth:
8.3K
Growth Rate:
1.82%
Total runs:
430.5K
Run Growth:
-183.5K
Growth Rate:
-42.63%
Total runs:
417.7K
Run Growth:
169.8K
Growth Rate:
40.65%
Total runs:
416.8K
Run Growth:
-227.3K
Growth Rate:
-52.10%
Total runs:
413.2K
Run Growth:
26.9K
Growth Rate:
6.51%
Total runs:
382.7K
Run Growth:
-39.0K
Growth Rate:
-9.84%
Total runs:
380.5K
Run Growth:
362.4K
Growth Rate:
95.24%
Total runs:
350.9K
Run Growth:
-670.4K
Growth Rate:
-191.05%
Total runs:
305.1K
Run Growth:
79.0K
Growth Rate:
25.90%
Total runs:
302.1K
Run Growth:
-184.2K
Growth Rate:
-60.96%
Total runs:
300.7K
Run Growth:
-36.4K
Growth Rate:
-12.10%
Total runs:
293.2K
Run Growth:
64.8K
Growth Rate:
22.11%
Total runs:
289.1K
Run Growth:
-22.3K
Growth Rate:
-7.70%
Total runs:
254.5K
Run Growth:
142.7K
Growth Rate:
56.04%
Total runs:
236.4K
Run Growth:
-249.0K
Growth Rate:
-106.14%
Total runs:
234.9K
Run Growth:
-311.3K
Growth Rate:
-132.50%
Total runs:
230.6K
Run Growth:
-26.8K
Growth Rate:
-11.64%
Total runs:
224.9K
Run Growth:
-72.8K
Growth Rate:
-32.39%
Total runs:
221.6K
Run Growth:
-568.7K
Growth Rate:
-256.67%
Total runs:
209.5K
Run Growth:
47.5K
Growth Rate:
22.65%
Total runs:
203.6K
Run Growth:
-61.8K
Growth Rate:
-29.54%
Total runs:
192.1K
Run Growth:
-619.8K
Growth Rate:
-322.55%
Total runs:
188.5K
Run Growth:
-58.4K
Growth Rate:
-31.01%
Total runs:
180.1K
Run Growth:
24.8K
Growth Rate:
13.77%
Total runs:
176.4K
Run Growth:
-75.6K
Growth Rate:
-42.86%
Total runs:
168.6K
Run Growth:
10.2K
Growth Rate:
6.07%
Total runs:
165.8K
Run Growth:
-45.6K
Growth Rate:
-27.18%
Total runs:
164.7K
Run Growth:
72.0K
Growth Rate:
43.73%
Total runs:
159.2K
Run Growth:
-46
Growth Rate:
-0.03%
Total runs:
139.6K
Run Growth:
68.9K
Growth Rate:
49.38%
Total runs:
137.3K
Run Growth:
2.0K
Growth Rate:
1.49%
Total runs:
136.2K
Run Growth:
-216.6K
Growth Rate:
-159.09%
Total runs:
126.1K
Run Growth:
13.3K
Growth Rate:
10.58%
Total runs:
123.4K
Run Growth:
13.0K
Growth Rate:
10.56%
Total runs:
122.3K
Run Growth:
-52.8K
Growth Rate:
-43.20%
Total runs:
117.8K
Run Growth:
-147.4K
Growth Rate:
-125.12%
Total runs:
117.6K
Run Growth:
-1.2K
Growth Rate:
-1.03%
Total runs:
115.6K
Run Growth:
-34.4K
Growth Rate:
-29.77%
Total runs:
109.7K
Run Growth:
59.9K
Growth Rate:
54.61%
Total runs:
108.6K
Run Growth:
22.2K
Growth Rate:
20.42%
Total runs:
103.6K
Run Growth:
-1.3K
Growth Rate:
-1.21%
Total runs:
100.5K
Run Growth:
54.7K
Growth Rate:
54.46%
Total runs:
96.0K
Run Growth:
91.7K
Growth Rate:
95.53%
Total runs:
93.3K
Run Growth:
457
Growth Rate:
0.50%
Total runs:
92.4K
Run Growth:
-15.5K
Growth Rate:
-16.80%
Total runs:
80.8K
Run Growth:
14.3K
Growth Rate:
17.65%
Total runs:
70.7K
Run Growth:
8.3K
Growth Rate:
11.73%
Total runs:
69.7K
Run Growth:
-13.1K
Growth Rate:
-18.74%
Total runs:
68.7K
Run Growth:
-18.2K
Growth Rate:
-26.47%
Total runs:
63.2K
Run Growth:
-119.7K
Growth Rate:
-191.53%
Total runs:
62.8K
Run Growth:
-94.3K
Growth Rate:
-150.13%
Total runs:
62.4K
Run Growth:
20.0K
Growth Rate:
32.09%
Total runs:
56.2K
Run Growth:
-1.2K
Growth Rate:
-2.22%
Total runs:
54.0K
Run Growth:
-25.0K
Growth Rate:
-46.36%
Total runs:
50.7K
Run Growth:
-13.7K
Growth Rate:
-26.97%
Total runs:
46.4K
Run Growth:
15.4K
Growth Rate:
33.16%
Total runs:
45.8K
Run Growth:
881
Growth Rate:
1.92%
Total runs:
45.3K
Run Growth:
4.4K
Growth Rate:
9.68%
Total runs:
43.9K
Run Growth:
-1.2K
Growth Rate:
-2.67%
Total runs:
42.8K
Run Growth:
21.5K
Growth Rate:
50.09%
Total runs:
40.4K
Run Growth:
17.5K
Growth Rate:
43.01%
Total runs:
35.1K
Run Growth:
-9.1K
Growth Rate:
-25.79%
Total runs:
35.0K
Run Growth:
5.2K
Growth Rate:
14.85%
Total runs:
32.9K
Run Growth:
1.7K
Growth Rate:
5.15%
Total runs:
32.5K
Run Growth:
30.2K
Growth Rate:
92.87%
Total runs:
30.7K
Run Growth:
-3.3K
Growth Rate:
-10.74%
Total runs:
30.7K
Run Growth:
-135.7K
Growth Rate:
-442.61%
Total runs:
28.8K
Run Growth:
-13.8K
Growth Rate:
-48.00%
Total runs:
25.5K
Run Growth:
3.0K
Growth Rate:
11.53%
Total runs:
23.5K
Run Growth:
1.1K
Growth Rate:
4.87%
Total runs:
23.3K
Run Growth:
9.4K
Growth Rate:
40.23%
Total runs:
22.7K
Run Growth:
6.5K
Growth Rate:
28.47%