Sponsored by APIMart
Toolify Toolify logo
AI Models
MOSS-Audio-4B-Instruct-GGUF

cstr / MOSS-Audio-4B-Instruct-GGUF

Run on huggingface.co
huggingface.co
Total runs: 1.5K
24-hour runs: 450
7-day runs: 238
30-day runs: 11
Model's Last Updated: August 02 2026
audio-text-to-text

Introduction of MOSS-Audio-4B-Instruct-GGUF

Model Details of MOSS-Audio-4B-Instruct-GGUF

MOSS-Audio-4B-Instruct -- GGUF (ggml-quantised)

GGUF / ggml conversions of OpenMOSS-Team/MOSS-Audio-4B-Instruct for use with crispasr --backend moss-audio from CrispStrobe/CrispASR .

MOSS-Audio-4B-Instruct is OpenMOSS's ~4.6 B parameter audio-understanding model:

  • First audio-understanding backend in CrispASR -- not just ASR but also audio QA, scene description, music analysis, meeting summarisation
  • Mandarin + English speech recognition and audio understanding
  • DeepStack cross-layer feature injection -- multi-resolution encoder taps at layers 8/16/24 injected into the LM's early layers for fine-grained prosody + semantic awareness
  • Time-aware ASR with explicit time-marker tokens for word-level and sentence-level timestamps
  • Apache-2.0 licence
Files
File Size Notes
moss-audio-4b-instruct-f16.gguf 9.73 GB F16, full precision
moss-audio-4b-instruct-q4_k.gguf 2.75 GB Q4_K -- recommended default
Quick Start 
# 1. Build the runtime
git clone https://github.com/CrispStrobe/CrispASR
cd CrispASR
cmake -G Ninja -B build -DCMAKE_BUILD_TYPE=Release -DGGML_CUDA=OFF
cmake --build build -j$(nproc) --target crispasr-cli

# 2. Download a quantisation
huggingface-cli download cstr/MOSS-Audio-4B-Instruct-GGUF \
    moss-audio-4b-instruct-q4_k.gguf --local-dir .

# 3. Transcribe audio
./build/bin/crispasr \
    -m moss-audio-4b-instruct-q4_k.gguf \
    -f your-audio.wav \
    --backend moss-audio -t 4

# 4. Audio understanding (custom prompt)
./build/bin/crispasr \
    -m moss-audio-4b-instruct-q4_k.gguf \
    -f your-audio.wav \
    --backend moss-audio \
    --prompt "Describe the sounds in this audio clip."
Architecture
Component Details
Audio encoder 32-layer Whisper-style transformer (d=1280, 20 heads, head_dim=64, FFN=5120, GELU, LayerNorm, eps=1e-5)
Conv stem 3x Conv2d(stride=2, channels=480, kernel=3x3, pad=1) -> 8x temporal downsample (128 mel bins -> 16 freq bins)
Stem projection Linear(480x16=7680 -> 1280) + sinusoidal positional embedding (max 1500 positions)
DeepStack taps Encoder layers [8, 16, 24] -> 3 independent GatedMLP(1280 -> 8192 -> 2560, SiLU)
DeepStack injection Residual add at LM layers [0, 1, 2] at audio-token positions
Audio adapter GatedMLP(1280 -> 8192 -> 2560, SiLU) for final encoder output
LM backbone 36-layer Qwen3 (hidden=2560, 32 Q-heads / 8 KV-heads, head_dim=128, QK-norm, SwiGLU FFN=9728, RoPE theta=1M)
Output head Linear(2560 -> 151936), untied from embedding
Vocab 151936 Qwen3 BPE (151643 regular + 293 special tokens)
Audio input 16 kHz mono, 128 mel bins, n_fft=400, hop=160
Audio tokens 12.5 Hz after 8x conv downsample, time markers every 2 seconds
Parameters ~4.6 B total (encoder ~650M + adapter/deepstack ~120M + LM ~3.8B)
Special tokens
Token ID Purpose
<|AUDIO|> 151654 Audio frame placeholder (replaced by encoder embeddings)
<|audio_bos|> 151669 Audio segment start marker
<|audio_eos|> 151670 Audio segment end marker
<|im_start|> 151644 Chat turn start
<|im_end|> 151645 Chat turn end / EOS
How this was made

  1. Inspect the HF safetensors: 3 shards, 901 tensors total -- audio encoder (conv stem + 32 transformer layers + layer_norm), audio adapter (1 GatedMLP), deepstack mergers (3 GatedMLPs), language model (embedding + 36 Qwen3 layers + final norm + lm_head).

  2. Convert with models/convert-moss-audio-to-gguf.py : stream BF16 tensors one-at-a-time via safe_open , remap HF tensor names ( audio_encoder.layers.N.self_attn.q_proj -> enc.blk.N.attn.q , deepstack_audio_merger_list.N.gate_proj -> deepstack.N.gate , language_model.layers.N.mlp.gate_proj -> llm.blk.N.ffn.gate , etc.), write F16 + F32 (norms/biases). BPE vocab + merges from vocab.json + merges.txt + added_tokens.json .

  3. Quantize with crispasr-quantize : F16 -> Q4_K (2D+ tensors quantised, 1D biases/norms kept F32).

  4. C++ runtime in src/moss_audio.{h,cpp} : GGUF mmap, encoder graph (conv stem + 32 WhisperEncoderLayers with bidirectional attention + DeepStack tap capture), adapter/merger GatedMLP graphs, per-layer DeepStack injection into LM via pre-scattered residuals, KV-cached Qwen3 decode with core_attn::kv_self_attn (QK-norm, RoPE, GQA), greedy decode with chat-template prompt builder.

Upstream

Runs of cstr MOSS-Audio-4B-Instruct-GGUF on huggingface.co

1.5K
Total runs
450
24-hour runs
239
3-day runs
238
7-day runs
11
30-day runs

More Information About MOSS-Audio-4B-Instruct-GGUF huggingface.co Model

More MOSS-Audio-4B-Instruct-GGUF license Visit here:

https://choosealicense.com/licenses/apache-2.0

MOSS-Audio-4B-Instruct-GGUF huggingface.co

MOSS-Audio-4B-Instruct-GGUF huggingface.co is an AI model on huggingface.co that provides MOSS-Audio-4B-Instruct-GGUF's model effect (), which can be used instantly with this cstr MOSS-Audio-4B-Instruct-GGUF model. huggingface.co supports a free trial of the MOSS-Audio-4B-Instruct-GGUF model, and also provides paid use of the MOSS-Audio-4B-Instruct-GGUF. Support call MOSS-Audio-4B-Instruct-GGUF model through api, including Node.js, Python, http.

MOSS-Audio-4B-Instruct-GGUF huggingface.co Url

https://huggingface.co/cstr/MOSS-Audio-4B-Instruct-GGUF

cstr MOSS-Audio-4B-Instruct-GGUF online free

MOSS-Audio-4B-Instruct-GGUF huggingface.co is an online trial and call api platform, which integrates MOSS-Audio-4B-Instruct-GGUF's modeling effects, including api services, and provides a free online trial of MOSS-Audio-4B-Instruct-GGUF, you can try MOSS-Audio-4B-Instruct-GGUF online for free by clicking the link below.

cstr MOSS-Audio-4B-Instruct-GGUF online free url in huggingface.co:

https://huggingface.co/cstr/MOSS-Audio-4B-Instruct-GGUF

MOSS-Audio-4B-Instruct-GGUF install

MOSS-Audio-4B-Instruct-GGUF is an open source model from GitHub that offers a free installation service, and any user can find MOSS-Audio-4B-Instruct-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of MOSS-Audio-4B-Instruct-GGUF install, users can directly use MOSS-Audio-4B-Instruct-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

MOSS-Audio-4B-Instruct-GGUF install url in huggingface.co:

https://huggingface.co/cstr/MOSS-Audio-4B-Instruct-GGUF

Url of MOSS-Audio-4B-Instruct-GGUF

MOSS-Audio-4B-Instruct-GGUF huggingface.co Url

Provider of MOSS-Audio-4B-Instruct-GGUF huggingface.co

cstr
ORGANIZATIONS
huggingface.co

Other API from cstr

 huggingface.co
cstr/chatterbox-GGUF

Total runs: 5.4K
Run Growth: 1.5K
Growth Rate: 27.51%
Updated:August 14 2026
huggingface.co
cstr/voxcpm2-GGUF

Total runs: 4.1K
Run Growth: 1.7K
Growth Rate: 39.19%
Updated:August 02 2026
huggingface.co
cstr/mimo-asr-GGUF

Total runs: 3.1K
Run Growth: 1.4K
Growth Rate: 43.34%
Updated:August 02 2026
huggingface.co
cstr/pocket-tts-GGUF

Total runs: 2.9K
Run Growth: 1.5K
Growth Rate: 53.31%
Updated:August 31 2026
huggingface.co
cstr/omnivoice-GGUF

Total runs: 2.6K
Run Growth: 1.1K
Growth Rate: 40.91%
Updated:August 02 2026
huggingface.co
cstr/kokoro-82m-GGUF

Total runs: 2.2K
Run Growth: 5
Growth Rate: 0.22%
Updated:August 02 2026
huggingface.co
cstr/crepe-GGUF

Total runs: 2.1K
Run Growth: -68
Growth Rate: -3.38%
Updated:August 02 2026
huggingface.co
cstr/bge-m3-GGUF

Total runs: 1.6K
Run Growth: -2.6K
Growth Rate: -174.63%
Updated:August 02 2026
huggingface.co
cstr/f5-tts-GGUF

Total runs: 1.6K
Run Growth: -318
Growth Rate: -20.73%
Updated:August 03 2026
huggingface.co
cstr/btc-chords-GGUF

Total runs: 1.5K
Run Growth: -85
Growth Rate: -6.01%
Updated:July 21 2026
huggingface.co
cstr/csm-1b-GGUF

Total runs: 1.1K
Run Growth: 425
Growth Rate: 39.17%
Updated:August 02 2026
huggingface.co
cstr/tabcnn-GGUF

Total runs: 1.1K
Run Growth: -50
Growth Rate: -4.68%
Updated:July 21 2026
huggingface.co
cstr/gigaam-v3-GGUF

Total runs: 1.0K
Run Growth: -2.0K
Growth Rate: -195.00%
Updated:August 02 2026
huggingface.co
cstr/dia-1.6b-GGUF

Total runs: 1.0K
Run Growth: 167
Growth Rate: 16.49%
Updated:August 02 2026
huggingface.co
cstr/m2m100-418m-GGUF

Total runs: 993
Run Growth: -232
Growth Rate: -22.66%
Updated:August 02 2026
huggingface.co
cstr/snac-24khz-GGUF

Total runs: 943
Run Growth: -15
Growth Rate: -1.62%
Updated:August 02 2026
huggingface.co
cstr/bark-small-GGUF

Total runs: 929
Run Growth: 175
Growth Rate: 19.34%
Updated:August 02 2026