cstr / voxtral-mini-4b-realtime-GGUF

huggingface.co
Total runs: 1.6K
24-hour runs: -12
7-day runs: -351
30-day runs: 145
Model's Last Updated: September 17 2026
automatic-speech-recognition

Introduction of voxtral-mini-4b-realtime-GGUF

Model Details of voxtral-mini-4b-realtime-GGUF

Voxtral-Mini-4B-Realtime — GGUF

GGUF quantizations of mistralai/Voxtral-Mini-4B-Realtime-2602 , a 4.4B-parameter realtime streaming speech-to-text model with a causal audio encoder and configurable transcription delay.

Converted and tested with CrispASR , a multi-model ASR framework built on ggml.

Files
File Quant Size Description
voxtral-mini-4b-realtime.gguf F16 8.3 GB Full precision (reference)
voxtral-mini-4b-realtime-q8_0.gguf Q8_0 4.5 GB 8-bit quantized
voxtral-mini-4b-realtime-q4_k.gguf Q4_K 2.4 GB 4-bit K-quant (recommended)
Performance (CPU, 4 threads, AVX2, jfk.wav 11s)
Quant Encoder Prefill Decode (ms/tok) Total RTFx
F16 39s 30s 430 133s 0.08×
Q8_0 30s 9s 257 79s 0.14×
Q4_K 19s 3s 177 49s 0.22×

Q4_K recommended — 3.5× smaller than F16, 2.7× faster, identical transcription quality.

Usage
# Build CrispASR
git clone https://github.com/CrispStrobe/CrispASR
cd CrispASR
cmake -B build -DCMAKE_BUILD_TYPE=Release
cmake --build build -j$(nproc) --target voxtral4b-main

# Download Q4_K (recommended)
huggingface-cli download cstr/voxtral-mini-4b-realtime-GGUF \
    voxtral-mini-4b-realtime-q4_k.gguf --local-dir .

# Transcribe
./build/bin/voxtral4b-main -m voxtral-mini-4b-realtime-q4_k.gguf -f audio.wav
With word-level timestamps
# Also download the CTC aligner
huggingface-cli download cstr/canary-ctc-aligner-GGUF \
    canary-ctc-aligner-q4_k.gguf --local-dir .

./build/bin/voxtral4b-main -m voxtral-mini-4b-realtime-q4_k.gguf \
    -f audio.wav -am canary-ctc-aligner-q4_k.gguf -timestamps
CLI options
-m  FNAME   GGUF model file (required)
-f  FNAME   Input audio, 16 kHz mono WAV (required)
-t  N       Threads (default: 4)
-l  LANG    Language hint (default: en)
-n  N       Max new tokens (default: 512)
-am FNAME   CTC aligner GGUF for word timestamps
-timestamps Enable word-level timestamps (requires -am)
-np         Suppress stderr info
Architecture
  • Audio encoder : 32-layer causal transformer (RoPE, SwiGLU, RMSNorm, sliding window 750)
  • LLM decoder : 26-layer Mistral (GQA 32/8, SwiGLU, adaptive RMSNorm, sliding window 8192)
  • Projector : 4-frame stack → Linear(5120→3072) → GELU → Linear(3072→3072)
  • Tokenizer : Mistral Tekken (150K vocab, 1000 special tokens)
  • Audio injection : adapter output ADDED to token embeddings (streaming format)
Key features
  • Natively streaming architecture with causal encoder
  • 13 languages : en, fr, es, de, ru, zh, ja, it, pt, nl, ar, hi, ko
  • Configurable delay : 480ms default (6 tokens × 80ms)
  • Apache 2.0 license
Conversion
python models/convert-voxtral4b-to-gguf.py \
    --input /path/to/Voxtral-Mini-4B-Realtime-2602 \
    --output voxtral-mini-4b-realtime.gguf

# Then quantize
./build/bin/cohere-quantize voxtral-mini-4b-realtime.gguf \
    voxtral-mini-4b-realtime-q4_k.gguf q4_k
Credits

Runs of cstr voxtral-mini-4b-realtime-GGUF on huggingface.co

1.6K
Total runs
-12
24-hour runs
-30
3-day runs
-351
7-day runs
145
30-day runs

More Information About voxtral-mini-4b-realtime-GGUF huggingface.co Model

More voxtral-mini-4b-realtime-GGUF license Visit here:

https://choosealicense.com/licenses/apache-2.0

voxtral-mini-4b-realtime-GGUF huggingface.co

voxtral-mini-4b-realtime-GGUF huggingface.co is an AI model on huggingface.co that provides voxtral-mini-4b-realtime-GGUF's model effect (), which can be used instantly with this cstr voxtral-mini-4b-realtime-GGUF model. huggingface.co supports a free trial of the voxtral-mini-4b-realtime-GGUF model, and also provides paid use of the voxtral-mini-4b-realtime-GGUF. Support call voxtral-mini-4b-realtime-GGUF model through api, including Node.js, Python, http.

voxtral-mini-4b-realtime-GGUF huggingface.co Url

https://huggingface.co/cstr/voxtral-mini-4b-realtime-GGUF

cstr voxtral-mini-4b-realtime-GGUF online free

voxtral-mini-4b-realtime-GGUF huggingface.co is an online trial and call api platform, which integrates voxtral-mini-4b-realtime-GGUF's modeling effects, including api services, and provides a free online trial of voxtral-mini-4b-realtime-GGUF, you can try voxtral-mini-4b-realtime-GGUF online for free by clicking the link below.

cstr voxtral-mini-4b-realtime-GGUF online free url in huggingface.co:

https://huggingface.co/cstr/voxtral-mini-4b-realtime-GGUF

voxtral-mini-4b-realtime-GGUF install

voxtral-mini-4b-realtime-GGUF is an open source model from GitHub that offers a free installation service, and any user can find voxtral-mini-4b-realtime-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of voxtral-mini-4b-realtime-GGUF install, users can directly use voxtral-mini-4b-realtime-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

voxtral-mini-4b-realtime-GGUF install url in huggingface.co:

https://huggingface.co/cstr/voxtral-mini-4b-realtime-GGUF

Url of voxtral-mini-4b-realtime-GGUF

voxtral-mini-4b-realtime-GGUF huggingface.co Url

Provider of voxtral-mini-4b-realtime-GGUF huggingface.co

cstr
ORGANIZATIONS

Other API from cstr

huggingface.co

Total runs: 5.1K
Run Growth: 1.1K
Growth Rate: 20.12%
Updated:August 14 2026
huggingface.co

Total runs: 4.2K
Run Growth: 1.5K
Growth Rate: 34.14%
Updated:August 02 2026
huggingface.co

Total runs: 3.1K
Run Growth: 1.3K
Growth Rate: 41.69%
Updated:August 02 2026
huggingface.co

Total runs: 3.0K
Run Growth: 1.7K
Growth Rate: 56.98%
Updated:August 31 2026
huggingface.co

Total runs: 2.6K
Run Growth: 792
Growth Rate: 30.73%
Updated:August 02 2026
huggingface.co

Total runs: 2.2K
Run Growth: -62
Growth Rate: -2.82%
Updated:August 02 2026
huggingface.co

Total runs: 2.1K
Run Growth: 42
Growth Rate: 2.01%
Updated:August 02 2026
huggingface.co

Total runs: 1.6K
Run Growth: -2.6K
Growth Rate: -164.05%
Updated:August 02 2026
huggingface.co

Total runs: 1.5K
Run Growth: -332
Growth Rate: -21.66%
Updated:August 03 2026
huggingface.co

Total runs: 1.5K
Run Growth: -187
Growth Rate: -12.73%
Updated:July 21 2026
huggingface.co

Total runs: 1.1K
Run Growth: 440
Growth Rate: 39.64%
Updated:August 02 2026
huggingface.co

Total runs: 1.1K
Run Growth: -38
Growth Rate: -3.45%
Updated:July 21 2026
huggingface.co

Total runs: 1.0K
Run Growth: 166
Growth Rate: 16.05%
Updated:August 02 2026
huggingface.co

Total runs: 1.0K
Run Growth: -2.0K
Growth Rate: -194.44%
Updated:August 02 2026
huggingface.co

Total runs: 985
Run Growth: -343
Growth Rate: -34.82%
Updated:August 02 2026
huggingface.co

Total runs: 935
Run Growth: 198
Growth Rate: 21.18%
Updated:August 02 2026
huggingface.co

Total runs: 934
Run Growth: -14
Growth Rate: -1.50%
Updated:August 02 2026
huggingface.co

Total runs: 895
Run Growth: -102
Growth Rate: -11.51%
Updated:August 02 2026
huggingface.co

Total runs: 858
Run Growth: 207
Growth Rate: 24.13%
Updated:August 02 2026