Sponsored by APIMaster
Toolify Toolify logo
AI Models
voxtral-mini-realtime-gguf

TrevorJS / voxtral-mini-realtime-gguf

Run on huggingface.co
huggingface.co
Total runs: 173
24-hour runs: 0
7-day runs: 23
30-day runs: 70
Model's Last Updated: March 29 2026
automatic-speech-recognition

Introduction of voxtral-mini-realtime-gguf

Model Details of voxtral-mini-realtime-gguf

Voxtral Mini 4B Realtime — Q4 GGUF

Q4_0 quantized GGUF weights for Voxtral Mini 4B Realtime , converted for use with voxtral-mini-realtime-rs .

Files
File Size Description
voxtral-q4.gguf 2.51 GB Q4_0 quantized model weights (GGUF v3)
tekken.json 14.9 MB Tekken tokenizer (131,072 vocab)
Usage
Native CLI 
cargo run --features "wgpu,cli,hub" --bin voxtral-transcribe -- \
  --audio input.wav \
  --gguf models/voxtral-q4.gguf \
  --tokenizer models/voxtral/tekken.json
Browser (WASM + WebGPU)

The Q4 GGUF is designed to run entirely client-side in a browser tab via WebGPU. See the GitHub repo for the full WASM build and dev server setup.

Quantization Details
  • Method : Q4_0 (4-bit quantization, block size 32, 18 bytes per block)
  • Original model : mistralai/Voxtral-Mini-4B-Realtime-2602 (~16 GB F32)
  • Quantized size : ~2.5 GB (fits in browser memory)
  • Inference : Custom WGSL shader for fused GPU dequantize + matmul
Links

Runs of TrevorJS voxtral-mini-realtime-gguf on huggingface.co

173
Total runs
0
24-hour runs
1
3-day runs
23
7-day runs
70
30-day runs

More Information About voxtral-mini-realtime-gguf huggingface.co Model

More voxtral-mini-realtime-gguf license Visit here:

https://choosealicense.com/licenses/apache-2.0

voxtral-mini-realtime-gguf huggingface.co

voxtral-mini-realtime-gguf huggingface.co is an AI model on huggingface.co that provides voxtral-mini-realtime-gguf's model effect (), which can be used instantly with this TrevorJS voxtral-mini-realtime-gguf model. huggingface.co supports a free trial of the voxtral-mini-realtime-gguf model, and also provides paid use of the voxtral-mini-realtime-gguf. Support call voxtral-mini-realtime-gguf model through api, including Node.js, Python, http.

voxtral-mini-realtime-gguf huggingface.co Url

https://huggingface.co/TrevorJS/voxtral-mini-realtime-gguf

TrevorJS voxtral-mini-realtime-gguf online free

voxtral-mini-realtime-gguf huggingface.co is an online trial and call api platform, which integrates voxtral-mini-realtime-gguf's modeling effects, including api services, and provides a free online trial of voxtral-mini-realtime-gguf, you can try voxtral-mini-realtime-gguf online for free by clicking the link below.

TrevorJS voxtral-mini-realtime-gguf online free url in huggingface.co:

https://huggingface.co/TrevorJS/voxtral-mini-realtime-gguf

voxtral-mini-realtime-gguf install

voxtral-mini-realtime-gguf is an open source model from GitHub that offers a free installation service, and any user can find voxtral-mini-realtime-gguf on GitHub to install. At the same time, huggingface.co provides the effect of voxtral-mini-realtime-gguf install, users can directly use voxtral-mini-realtime-gguf installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

voxtral-mini-realtime-gguf install url in huggingface.co:

https://huggingface.co/TrevorJS/voxtral-mini-realtime-gguf

Url of voxtral-mini-realtime-gguf

voxtral-mini-realtime-gguf huggingface.co Url

Provider of voxtral-mini-realtime-gguf huggingface.co

TrevorJS
ORGANIZATIONS
huggingface.co

Other API from TrevorJS

 huggingface.co
TrevorJS/dpo

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:September 18 2023