Sponsored by ThumbnailCreator.com
Toolify Toolify logo
AI Models
glm-moe-dsa-tiny-random-q4_0-rtn-format

malaiwah / glm-moe-dsa-tiny-random-q4_0-rtn-format

Run on huggingface.co
huggingface.co
Total runs: 88
24-hour runs: 6
7-day runs: 1
30-day runs: 34
Model's Last Updated: September 08 2026

Introduction of glm-moe-dsa-tiny-random-q4_0-rtn-format

Model Details of glm-moe-dsa-tiny-random-q4_0-rtn-format

GLM MoE DSA — q4_0: a tiny toolchain fixture

A q4_0 storage/reader fixture , built from a tiny random reference checkpoint. Use it to inspect packing, reconstruction, scope accounting, and own-head fidelity comparisons—not to choose a production quantizer.

These weights are untrained, not an assistant, and not a language-quality benchmark. Generated text has no useful semantic quality. No upstream trained weights or training data are implied by an architecture name.

Weight lineage

This is a quantization of a shared native checkpoint , not an independent random initialization and not a fine-tune. HF base_model / base_model_relation: quantized metadata names the real source model.

Exact construction source: malaiwah/glm-moe-dsa-tiny-random-bf16@45563636ef723acfb826755493447dc40c7a0c37 .

All 8 derivatives in this family were measured against the same complete source checkpoint identity:

800be70604bef0c3adfb429774f44756d60bf23d141e82d24a032ce25ce0451e

That identity binds config and weight bytes; equal architecture names or random seeds are not used as a substitute. Quantized storage cases use round-to-nearest packing and do not claim GPTQ/AWQ/ModelOpt optimization or calibration.

Browse the Matched-Weight Quantization Families collection .

At a glance
Property Observed value
Artifact role Child storage fixture; captured role quant ; classification lossy
Serialized top-level weight files 182,944 bytes (0.174 MiB); metadata, tokenizer and evidence excluded
Source-model generated parameters (before packing) 277,824
Fixture vocabulary 260 tokens; independent byte tokenizer, not upstream vocabulary
CPU stack Python 3.12; Torch 2.11.0+cpu; Transformers 5.16.1; two Torch threads in the recorded capture workflow
Remote model code Not required: native Transformers class behind QFS

Size is serialized artifact size, not runtime RAM or a capacity/performance guarantee. Packed-array element counts are not model parameter counts.

What is actually included

Four text decoder layers (one dense, three MoE), MLA attention, alternating full/shared DSA indexers, 8 routed experts/top-2 plus one shared expert, and a complete untied vocabulary head. Native FP32 router buffers are retained; no MTP.

Storage intervention: q4_0; random FORMAT fixture.

  • GLM MoE DSA; full random tiny checkpoint; header-derived GGUF geometry; not all GGUF architectures
  • Output-head policy: quantized . The comparison replays each side through its own sealed head, including any head error; the reference head is not substituted.
  • Weights reconstructed to BF16; dynamic FP8 activation quantization not captured; no serving-kernel parity claim

The repository file inventory includes config.json , generation_config.json , tokenizer.json , tokenizer_config.json , scope.json , build.json . Exact build/runtime/license inventories are linked below. A file may describe historical provenance without being an executable entry point.

Good community uses—and boundaries
  • Learn how to download pinned artifacts, seal a small synthetic token panel, capture hidden states and replay a full vocabulary head.
  • Debug model-family adapters, strict tensor loading, storage decoders, or reproducibility tooling without downloading a production-sized checkpoint.
  • Reproduce a narrowly scoped result, report an adapter/reader regression, and retain the source, panel and runtime identities needed to explain it.

Not established: trained-model accuracy; useful instruction following; quantizer optimization quality; original production-weight compatibility; GPU/NPU/serving-kernel parity; cross-hardware determinism; long-context behavior outside the recorded panel; throughput or paid-compute admission.

RTN is round-to-nearest packing, not optimization. These cases do not run GPTQ, AWQ or AutoRound optimization, calibrated ModelOpt/CT/QAT training, or activation-aware tuning. CPU reconstruction does not execute the original packed GEMM or serving activation arithmetic.

Model family, root dataset and evidence

Exact construction source: malaiwah/glm-moe-dsa-tiny-random-bf16@45563636ef723acfb826755493447dc40c7a0c37 . This is the actual source pin; later documentation commits do not rewrite that history. Family fidelity-root dataset repository and storage evidence bundle . The root model is separate; this child must not be registered or represented as the base model . Canonical roots and their evidence are published; registry links distinguish native bases from child/control artifacts.

Recorded own-head result
Measurement Recorded value
Mean KL(reference ∥ candidate) 0.001091329799942506 nats
Scored positions 252; synthetic, not benchmark data
Comparability advisory ; reconstruction/activation omissions remain in force
Top-1 agreement 0.6666666666666666 on this panel only

Full comparison receipt includes per-context/tokenwise evidence, comparison gates and disclosures. Receipt self-digest: d4db54be952c7d83cff445772656c13efd8b88b97f7eb48bd14ede83a06a92cb . No threshold or usable determinism floor is invented here.

Material disclosures from the observed receipt:

  • HEAD-1d: each side replayed through its own sealed head (reference 2364995d4009, candidate 8d7b7b4c1797); head error is inside the measurement, as under HEAD-2, and nothing is substituted. The heads differ in content.
  • candidate was captured from a WEIGHTS-ONLY RECONSTRUCTION (gguf-dequant-to-bf16, output bfloat16). The stored weights were decoded before the model forward; native quantized GEMM and serving activation arithmetic are not measured. Decoder provenance is in the sealed runtime receipt. The comparison is advisory.
Runtime requirements and safe local reproduction
Replay the published evidence without loading a model

This uses QFS's existing NumPy FP64 comparator in a Torch-free environment . It reads the stored hidden states and each side's own head. No model forward, remote model code, GPU, upload or registry mutation is involved. Runtime receipts name the actual backend; last-bit differences from another FP64 implementation are not a new quality claim. Synthetic exact controls remain zero.

Set QFS to a reviewed Quant Fidelity Suite checkout and use Bash: 

: "${QFS:?Set QFS to your reviewed QFS checkout}"
WORK=$(mktemp -d)
export OMP_NUM_THREADS=2 MKL_NUM_THREADS=2 OPENBLAS_NUM_THREADS=2
python3.12 -m venv "$WORK/replay-env"
"$WORK/replay-env/bin/pip" install 'numpy==2.5.3' 'huggingface-hub==1.30.0'
"$WORK/replay-env/bin/hf" download malaiwah/qfs-existing-tiny-cpu-format-v1 --repo-type dataset \
  --revision 2b5c947281a92d1f104ee17fdcc44a0104768a45 --include 'raw/candidates/q4_0/evidence/**' --local-dir "$WORK/evidence"
"$WORK/replay-env/bin/python" "$QFS/bin/fidelity_dataset.py" verify \
  "$WORK/evidence/raw/candidates/q4_0/evidence/reference" --verify-tensors
"$WORK/replay-env/bin/python" "$QFS/bin/fidelity_dataset.py" verify \
  "$WORK/evidence/raw/candidates/q4_0/evidence/q4_0" --verify-tensors
"$WORK/replay-env/bin/python" "$QFS/bin/fidelity_dataset.py" compare \
  --reference "$WORK/evidence/raw/candidates/q4_0/evidence/reference" \
  --candidate "$WORK/evidence/raw/candidates/q4_0/evidence/q4_0" \
  --out "$WORK/replayed" --device cpu --replay-device numpy --replay-dtype float32 \
  --vocab-chunk 8192 --verify-tensors --own-heads --force-compute

Reconstructed format comparisons are intentionally advisory and normally return exit code 2 while writing a valid receipt. Inspect that receipt; do not silence refusals or interpret an advisory result as a production-quality ranking.

Capture the actual checkpoint

Capture uses a separate pinned Torch CPU environment. The input below is the original token-panel format , not a sealed capture's internal panel/ folder. The native source, tokenizer and model revisions remain explicit. Set AUTHOR to your own HF handle; the dataset repository argument is attribution only and nothing is uploaded by these commands. 

: "${AUTHOR:?Set AUTHOR to your Hugging Face handle}"
"$WORK/replay-env/bin/hf" download malaiwah/glm-moe-dsa-tiny-random-q4_0-rtn-format --revision c0e73b84e074c800ea906f46d1d9cf3d04bcf88c --local-dir "$WORK/model"
"$WORK/replay-env/bin/hf" download malaiwah/glm-moe-dsa-tiny-random-bf16 --revision 45563636ef723acfb826755493447dc40c7a0c37 --local-dir "$WORK/source"
"$WORK/replay-env/bin/hf" download malaiwah/qfs-fixture-root-captures-v1 --repo-type dataset \
  --revision f53b204091c988ce4a2161af81886f3018745559 --include 'requirements-capture.txt' --include 'roots/glm_moe_dsa/input-panel/**' \
  --local-dir "$WORK/inputs"
python3.12 -m venv "$WORK/capture-env"
"$WORK/capture-env/bin/pip" install -r "$WORK/inputs/requirements-capture.txt"
"$WORK/capture-env/bin/python" "$QFS/bin/fidelity_dataset.py" architectures prepare \
  --architecture glm_moe_dsa --model-dir "$WORK/model" \
  --model-repository malaiwah/glm-moe-dsa-tiny-random-q4_0-rtn-format --model-revision c0e73b84e074c800ea906f46d1d9cf3d04bcf88c \
  --panel "$WORK/inputs/roots/glm_moe_dsa/input-panel" --tokenizer-root "$WORK/source" \
  --author "$AUTHOR" --dataset-repository "$AUTHOR/glm-moe-dsa-tiny-random-q4_0-rtn-format-capture" \
  --dataset-id "fidelity--$AUTHOR.glm-moe-dsa-tiny-random-q4_0-rtn-format" --out "$WORK/workflow" \
  --role quant --scope-file "$WORK/model/scope.json" --codec gguf-k-quant --bits 4.0 \
  --reference hf://malaiwah/glm-moe-dsa-tiny-fidelity-root-v1@b8ed427805abdfd6b8b20db10ca5107e840d0497

Inspect workflow.json . This launcher executes its exact capture/verification commands and selects the Torch-free interpreter only for the final comparison: 

export OMP_NUM_THREADS=2 MKL_NUM_THREADS=2 OPENBLAS_NUM_THREADS=2
"$WORK/replay-env/bin/python" - "$WORK/workflow/workflow.json" <<'PY'
import json, subprocess, sys
workflow = json.load(open(sys.argv[1]))
for step in workflow["commands"]:
    argv = list(step["argv"])
    if step["step"] == "compare":
        argv[0] = sys.executable
    result = subprocess.run(argv)
    if result.returncode:
        raise SystemExit(result.returncode)
PY

Use the actual root at malaiwah/glm-moe-dsa-tiny-fidelity-root-v1@b8ed427805abdfd6b8b20db10ca5107e840d0497 . The community collection groups models and captures. Custom code, where required above, is explicitly pinned and executed only after your consent; hash verification is provenance, not a sandbox .

Licensing and detailed provenance

The fixture repository retains its mit license in LICENSE . This covers the fixture only according to that exact text; architecture inspiration is not relicensing of upstream weights, cards, code, or configuration. Dependencies retain their own licenses (native Transformers implementation: Apache-2.0). No upstream trained tensors are claimed to be copied.

The exact source license is retained, unchanged, from malaiwah/glm-moe-dsa-tiny-random-bf16 . The storage conversion does not grant new upstream rights.

Immutable provenance, historical cards, source inventories and full caveats

Selected original provenance fields (full tensor/component evidence remains in the linked inventories): 

{
  "source": {
    "repository": "malaiwah/glm-moe-dsa-tiny-random-bf16",
    "revision": "45563636ef723acfb826755493447dc40c7a0c37"
  },
  "format": "q4_0; random FORMAT fixture",
  "classification": "lossy",
  "architecture_restrictions": [
    "GLM MoE DSA; full random tiny checkpoint; header-derived GGUF geometry; not all GGUF architectures"
  ],
  "activation_omissions": [
    "Weights reconstructed to BF16; dynamic FP8 activation quantization not captured; no serving-kernel parity claim"
  ],
  "head_policy": "quantized"
}

Additional original storage-build provenance (tensor entries remain in build.json ): 

{
  "all_source_tensors_preserved": true,
  "canonical_placement_parity": "all tensors exact independently assembled upstream decode",
  "changed_canonical_tensors": [
    "model.layers.0.self_attn.kv_a_proj_with_mqa.weight",
    "model.layers.0.self_attn.o_proj.weight",
    "model.layers.0.self_attn.q_a_proj.weight",
    "model.layers.0.self_attn.q_b_proj.weight",
    "model.layers.0.mlp.down_proj.weight",
    "model.layers.0.mlp.gate_proj.weight",
    "model.layers.0.mlp.up_proj.weight",
    "model.layers.0.self_attn.indexer.wk.weight",
    "model.layers.0.self_attn.indexer.wq_b.weight",
    "model.layers.0.self_attn.indexer.weights_proj.weight",
    "model.layers.1.self_attn.kv_a_proj_with_mqa.weight",
    "model.layers.1.self_attn.o_proj.weight",
    "model.layers.1.self_attn.q_a_proj.weight",
    "model.layers.1.self_attn.q_b_proj.weight",
    "model.layers.1.mlp.experts.0.down_proj.weight",
    "model.layers.1.mlp.experts.1.down_proj.weight",
    "model.layers.1.mlp.experts.2.down_proj.weight",
    "model.layers.1.mlp.experts.3.down_proj.weight",
    "model.layers.1.mlp.experts.4.down_proj.weight",
    "model.layers.1.mlp.experts.5.down_proj.weight",
    "model.layers.1.mlp.experts.6.down_proj.weight",
    "model.layers.1.mlp.experts.7.down_proj.weight",
    "model.layers.1.mlp.shared_experts.down_proj.weight",
    "model.layers.1.mlp.experts.0.gate_proj.weight",
    "model.layers.1.mlp.experts.1.gate_proj.weight",
    "model.layers.1.mlp.experts.2.gate_proj.weight",
    "model.layers.1.mlp.experts.3.gate_proj.weight",
    "model.layers.1.mlp.experts.4.gate_proj.weight",
    "model.layers.1.mlp.experts.5.gate_proj.weight",
    "model.layers.1.mlp.experts.6.gate_proj.weight",
    "model.layers.1.mlp.experts.7.gate_proj.weight",
    "model.layers.1.mlp.gate.weight",
    "model.layers.1.mlp.shared_experts.gate_proj.weight",
    "model.layers.1.mlp.experts.0.up_proj.weight",
    "model.layers.1.mlp.experts.1.up_proj.weight",
    "model.layers.1.mlp.experts.2.up_proj.weight",
    "model.layers.1.mlp.experts.3.up_proj.weight",
    "model.layers.1.mlp.experts.4.up_proj.weight",
    "model.layers.1.mlp.experts.5.up_proj.weight",
    "model.layers.1.mlp.experts.6.up_proj.weight",
    "model.layers.1.mlp.experts.7.up_proj.weight",
    "model.layers.1.mlp.shared_experts.up_proj.weight",
    "model.layers.2.self_attn.kv_a_proj_with_mqa.weight",
    "model.layers.2.self_attn.o_proj.weight",
    "model.layers.2.self_attn.q_a_proj.weight",
    "model.layers.2.self_attn.q_b_proj.weight",
    "model.layers.2.mlp.experts.0.down_proj.weight",
    "model.layers.2.mlp.experts.1.down_proj.weight",
    "model.layers.2.mlp.experts.2.down_proj.weight",
    "model.layers.2.mlp.experts.3.down_proj.weight",
    "model.layers.2.mlp.experts.4.down_proj.weight",
    "model.layers.2.mlp.experts.5.down_proj.weight",
    "model.layers.2.mlp.experts.6.down_proj.weight",
    "model.layers.2.mlp.experts.7.down_proj.weight",
    "model.layers.2.mlp.shared_experts.down_proj.weight",
    "model.layers.2.mlp.experts.0.gate_proj.weight",
    "model.layers.2.mlp.experts.1.gate_proj.weight",
    "model.layers.2.mlp.experts.2.gate_proj.weight",
    "model.layers.2.mlp.experts.3.gate_proj.weight",
    "model.layers.2.mlp.experts.4.gate_proj.weight",
    "model.layers.2.mlp.experts.5.gate_proj.weight",
    "model.layers.2.mlp.experts.6.gate_proj.weight",
    "model.layers.2.mlp.experts.7.gate_proj.weight",
    "model.layers.2.mlp.gate.weight",
    "model.layers.2.mlp.shared_experts.gate_proj.weight",
    "model.layers.2.mlp.experts.0.up_proj.weight",
    "model.layers.2.mlp.experts.1.up_proj.weight",
    "model.layers.2.mlp.experts.2.up_proj.weight",
    "model.layers.2.mlp.experts.3.up_proj.weight",
    "model.layers.2.mlp.experts.4.up_proj.weight",
    "model.layers.2.mlp.experts.5.up_proj.weight",
    "model.layers.2.mlp.experts.6.up_proj.weight",
    "model.layers.2.mlp.experts.7.up_proj.weight",
    "model.layers.2.mlp.shared_experts.up_proj.weight",
    "model.layers.2.self_attn.indexer.wk.weight",
    "model.layers.2.self_attn.indexer.wq_b.weight",
    "model.layers.2.self_attn.indexer.weights_proj.weight",
    "model.layers.3.self_attn.kv_a_proj_with_mqa.weight",
    "model.layers.3.self_attn.o_proj.weight",
    "model.layers.3.self_attn.q_a_proj.weight",
    "model.layers.3.self_attn.q_b_proj.weight",
    "model.layers.3.mlp.experts.0.down_proj.weight",
    "model.layers.3.mlp.experts.1.down_proj.weight",
    "model.layers.3.mlp.experts.2.down_proj.weight",
    "model.layers.3.mlp.experts.3.down_proj.weight",
    "model.layers.3.mlp.experts.4.down_proj.weight",
    "model.layers.3.mlp.experts.5.down_proj.weight",
    "model.layers.3.mlp.experts.6.down_proj.weight",
    "model.layers.3.mlp.experts.7.down_proj.weight",
    "model.layers.3.mlp.shared_experts.down_proj.weight",
    "model.layers.3.mlp.experts.0.gate_proj.weight",
    "model.layers.3.mlp.experts.1.gate_proj.weight",
    "model.layers.3.mlp.experts.2.gate_proj.weight",
    "model.layers.3.mlp.experts.3.gate_proj.weight",
    "model.layers.3.mlp.experts.4.gate_proj.weight",
    "model.layers.3.mlp.experts.5.gate_proj.weight",
    "model.layers.3.mlp.experts.6.gate_proj.weight",
    "model.layers.3.mlp.experts.7.gate_proj.weight",
    "model.layers.3.mlp.gate.weight",
    "model.layers.3.mlp.shared_experts.gate_proj.weight",
    "model.layers.3.mlp.experts.0.up_proj.weight",
    "model.layers.3.mlp.experts.1.up_proj.weight",
    "model.layers.3.mlp.experts.2.up_proj.weight",
    "model.layers.3.mlp.experts.3.up_proj.weight",
    "model.layers.3.mlp.experts.4.up_proj.weight",
    "model.layers.3.mlp.experts.5.up_proj.weight",
    "model.layers.3.mlp.experts.6.up_proj.weight",
    "model.layers.3.mlp.experts.7.up_proj.weight",
    "model.layers.3.mlp.shared_experts.up_proj.weight",
    "lm_head.weight",
    "model.embed_tokens.weight"
  ],
  "claim": "FORMAT fixture; random BF16 source, not trained quality or optimized serving evidence",
  "container_tensors": [
    {
      "elements": 512,
      "name": "blk.0.attn_k_b.weight",
      "payload_bytes": 1024,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        4,
        16,
        8
      ],
      "type": "BF16"
    },
    {
      "elements": 1536,
      "name": "blk.0.attn_kv_a_mqa.weight",
      "payload_bytes": 864,
      "reason": "block32-aligned matrix",
      "shape": [
        24,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 16,
      "name": "blk.0.attn_kv_a_norm.weight",
      "payload_bytes": 32,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        16
      ],
      "type": "BF16"
    },
    {
      "elements": 64,
      "name": "blk.0.attn_norm.weight",
      "payload_bytes": 128,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        64
      ],
      "type": "BF16"
    },
    {
      "elements": 4096,
      "name": "blk.0.attn_output.weight",
      "payload_bytes": 2304,
      "reason": "block32-aligned matrix",
      "shape": [
        64,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 2048,
      "name": "blk.0.attn_q_a.weight",
      "payload_bytes": 1152,
      "reason": "block32-aligned matrix",
      "shape": [
        32,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 32,
      "name": "blk.0.attn_q_a_norm.weight",
      "payload_bytes": 64,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        32
      ],
      "type": "BF16"
    },
    {
      "elements": 2048,
      "name": "blk.0.attn_q_b.weight",
      "payload_bytes": 1152,
      "reason": "block32-aligned matrix",
      "shape": [
        64,
        32
      ],
      "type": "Q4_0"
    },
    {
      "elements": 1024,
      "name": "blk.0.attn_v_b.weight",
      "payload_bytes": 2048,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        4,
        16,
        16
      ],
      "type": "BF16"
    },
    {
      "elements": 8192,
      "name": "blk.0.ffn_down.weight",
      "payload_bytes": 4608,
      "reason": "block32-aligned matrix",
      "shape": [
        64,
        128
      ],
      "type": "Q4_0"
    },
    {
      "elements": 8192,
      "name": "blk.0.ffn_gate.weight",
      "payload_bytes": 4608,
      "reason": "block32-aligned matrix",
      "shape": [
        128,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 64,
      "name": "blk.0.ffn_norm.weight",
      "payload_bytes": 128,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        64
      ],
      "type": "BF16"
    },
    {
      "elements": 8192,
      "name": "blk.0.ffn_up.weight",
      "payload_bytes": 4608,
      "reason": "block32-aligned matrix",
      "shape": [
        128,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 1024,
      "name": "blk.0.indexer.attn_k.weight",
      "payload_bytes": 576,
      "reason": "block32-aligned matrix",
      "shape": [
        16,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 2048,
      "name": "blk.0.indexer.attn_q_b.weight",
      "payload_bytes": 1152,
      "reason": "block32-aligned matrix",
      "shape": [
        64,
        32
      ],
      "type": "Q4_0"
    },
    {
      "elements": 16,
      "name": "blk.0.indexer.k_norm.bias",
      "payload_bytes": 32,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        16
      ],
      "type": "BF16"
    },
    {
      "elements": 16,
      "name": "blk.0.indexer.k_norm.weight",
      "payload_bytes": 32,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        16
      ],
      "type": "BF16"
    },
    {
      "elements": 256,
      "name": "blk.0.indexer.proj.weight",
      "payload_bytes": 144,
      "reason": "block32-aligned matrix",
      "shape": [
        4,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 512,
      "name": "blk.1.attn_k_b.weight",
      "payload_bytes": 1024,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        4,
        16,
        8
      ],
      "type": "BF16"
    },
    {
      "elements": 1536,
      "name": "blk.1.attn_kv_a_mqa.weight",
      "payload_bytes": 864,
      "reason": "block32-aligned matrix",
      "shape": [
        24,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 16,
      "name": "blk.1.attn_kv_a_norm.weight",
      "payload_bytes": 32,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        16
      ],
      "type": "BF16"
    },
    {
      "elements": 64,
      "name": "blk.1.attn_norm.weight",
      "payload_bytes": 128,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        64
      ],
      "type": "BF16"
    },
    {
      "elements": 4096,
      "name": "blk.1.attn_output.weight",
      "payload_bytes": 2304,
      "reason": "block32-aligned matrix",
      "shape": [
        64,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 2048,
      "name": "blk.1.attn_q_a.weight",
      "payload_bytes": 1152,
      "reason": "block32-aligned matrix",
      "shape": [
        32,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 32,
      "name": "blk.1.attn_q_a_norm.weight",
      "payload_bytes": 64,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        32
      ],
      "type": "BF16"
    },
    {
      "elements": 2048,
      "name": "blk.1.attn_q_b.weight",
      "payload_bytes": 1152,
      "reason": "block32-aligned matrix",
      "shape": [
        64,
        32
      ],
      "type": "Q4_0"
    },
    {
      "elements": 1024,
      "name": "blk.1.attn_v_b.weight",
      "payload_bytes": 2048,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        4,
        16,
        16
      ],
      "type": "BF16"
    },
    {
      "elements": 8,
      "name": "blk.1.exp_probs_b.bias",
      "payload_bytes": 32,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        8
      ],
      "type": "F32"
    },
    {
      "elements": 16384,
      "name": "blk.1.ffn_down_exps.weight",
      "payload_bytes": 9216,
      "reason": "block32-aligned matrix",
      "shape": [
        8,
        64,
        32
      ],
      "type": "Q4_0"
    },
    {
      "elements": 2048,
      "name": "blk.1.ffn_down_shexp.weight",
      "payload_bytes": 1152,
      "reason": "block32-aligned matrix",
      "shape": [
        64,
        32
      ],
      "type": "Q4_0"
    },
    {
      "elements": 16384,
      "name": "blk.1.ffn_gate_exps.weight",
      "payload_bytes": 9216,
      "reason": "block32-aligned matrix",
      "shape": [
        8,
        32,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 512,
      "name": "blk.1.ffn_gate_inp.weight",
      "payload_bytes": 288,
      "reason": "block32-aligned matrix",
      "shape": [
        8,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 2048,
      "name": "blk.1.ffn_gate_shexp.weight",
      "payload_bytes": 1152,
      "reason": "block32-aligned matrix",
      "shape": [
        32,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 64,
      "name": "blk.1.ffn_norm.weight",
      "payload_bytes": 128,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        64
      ],
      "type": "BF16"
    },
    {
      "elements": 16384,
      "name": "blk.1.ffn_up_exps.weight",
      "payload_bytes": 9216,
      "reason": "block32-aligned matrix",
      "shape": [
        8,
        32,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 2048,
      "name": "blk.1.ffn_up_shexp.weight",
      "payload_bytes": 1152,
      "reason": "block32-aligned matrix",
      "shape": [
        32,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 1024,
      "name": "blk.1.indexer.attn_k.weight",
      "payload_bytes": 576,
      "reason": "block32-aligned matrix",
      "shape": [
        16,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 2048,
      "name": "blk.1.indexer.attn_q_b.weight",
      "payload_bytes": 1152,
      "reason": "block32-aligned matrix",
      "shape": [
        64,
        32
      ],
      "type": "Q4_0"
    },
    {
      "elements": 16,
      "name": "blk.1.indexer.k_norm.bias",
      "payload_bytes": 32,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        16
      ],
      "type": "BF16"
    },
    {
      "elements": 16,
      "name": "blk.1.indexer.k_norm.weight",
      "payload_bytes": 32,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        16
      ],
      "type": "BF16"
    },
    {
      "elements": 256,
      "name": "blk.1.indexer.proj.weight",
      "payload_bytes": 144,
      "reason": "block32-aligned matrix",
      "shape": [
        4,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 512,
      "name": "blk.2.attn_k_b.weight",
      "payload_bytes": 1024,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        4,
        16,
        8
      ],
      "type": "BF16"
    },
    {
      "elements": 1536,
      "name": "blk.2.attn_kv_a_mqa.weight",
      "payload_bytes": 864,
      "reason": "block32-aligned matrix",
      "shape": [
        24,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 16,
      "name": "blk.2.attn_kv_a_norm.weight",
      "payload_bytes": 32,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        16
      ],
      "type": "BF16"
    },
    {
      "elements": 64,
      "name": "blk.2.attn_norm.weight",
      "payload_bytes": 128,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        64
      ],
      "type": "BF16"
    },
    {
      "elements": 4096,
      "name": "blk.2.attn_output.weight",
      "payload_bytes": 2304,
      "reason": "block32-aligned matrix",
      "shape": [
        64,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 2048,
      "name": "blk.2.attn_q_a.weight",
      "payload_bytes": 1152,
      "reason": "block32-aligned matrix",
      "shape": [
        32,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 32,
      "name": "blk.2.attn_q_a_norm.weight",
      "payload_bytes": 64,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        32
      ],
      "type": "BF16"
    },
    {
      "elements": 2048,
      "name": "blk.2.attn_q_b.weight",
      "payload_bytes": 1152,
      "reason": "block32-aligned matrix",
      "shape": [
        64,
        32
      ],
      "type": "Q4_0"
    },
    {
      "elements": 1024,
      "name": "blk.2.attn_v_b.weight",
      "payload_bytes": 2048,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        4,
        16,
        16
      ],
      "type": "BF16"
    },
    {
      "elements": 8,
      "name": "blk.2.exp_probs_b.bias",
      "payload_bytes": 32,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        8
      ],
      "type": "F32"
    },
    {
      "elements": 16384,
      "name": "blk.2.ffn_down_exps.weight",
      "payload_bytes": 9216,
      "reason": "block32-aligned matrix",
      "shape": [
        8,
        64,
        32
      ],
      "type": "Q4_0"
    },
    {
      "elements": 2048,
      "name": "blk.2.ffn_down_shexp.weight",
      "payload_bytes": 1152,
      "reason": "block32-aligned matrix",
      "shape": [
        64,
        32
      ],
      "type": "Q4_0"
    },
    {
      "elements": 16384,
      "name": "blk.2.ffn_gate_exps.weight",
      "payload_bytes": 9216,
      "reason": "block32-aligned matrix",
      "shape": [
        8,
        32,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 512,
      "name": "blk.2.ffn_gate_inp.weight",
      "payload_bytes": 288,
      "reason": "block32-aligned matrix",
      "shape": [
        8,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 2048,
      "name": "blk.2.ffn_gate_shexp.weight",
      "payload_bytes": 1152,
      "reason": "block32-aligned matrix",
      "shape": [
        32,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 64,
      "name": "blk.2.ffn_norm.weight",
      "payload_bytes": 128,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        64
      ],
      "type": "BF16"
    },
    {
      "elements": 16384,
      "name": "blk.2.ffn_up_exps.weight",
      "payload_bytes": 9216,
      "reason": "block32-aligned matrix",
      "shape": [
        8,
        32,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 2048,
      "name": "blk.2.ffn_up_shexp.weight",
      "payload_bytes": 1152,
      "reason": "block32-aligned matrix",
      "shape": [
        32,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 1024,
      "name": "blk.2.indexer.attn_k.weight",
      "payload_bytes": 576,
      "reason": "block32-aligned matrix",
      "shape": [
        16,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 2048,
      "name": "blk.2.indexer.attn_q_b.weight",
      "payload_bytes": 1152,
      "reason": "block32-aligned matrix",
      "shape": [
        64,
        32
      ],
      "type": "Q4_0"
    },
    {
      "elements": 16,
      "name": "blk.2.indexer.k_norm.bias",
      "payload_bytes": 32,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        16
      ],
      "type": "BF16"
    },
    {
      "elements": 16,
      "name": "blk.2.indexer.k_norm.weight",
      "payload_bytes": 32,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        16
      ],
      "type": "BF16"
    },
    {
      "elements": 256,
      "name": "blk.2.indexer.proj.weight",
      "payload_bytes": 144,
      "reason": "block32-aligned matrix",
      "shape": [
        4,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 512,
      "name": "blk.3.attn_k_b.weight",
      "payload_bytes": 1024,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        4,
        16,
        8
      ],
      "type": "BF16"
    },
    {
      "elements": 1536,
      "name": "blk.3.attn_kv_a_mqa.weight",
      "payload_bytes": 864,
      "reason": "block32-aligned matrix",
      "shape": [
        24,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 16,
      "name": "blk.3.attn_kv_a_norm.weight",
      "payload_bytes": 32,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        16
      ],
      "type": "BF16"
    },
    {
      "elements": 64,
      "name": "blk.3.attn_norm.weight",
      "payload_bytes": 128,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        64
      ],
      "type": "BF16"
    },
    {
      "elements": 4096,
      "name": "blk.3.attn_output.weight",
      "payload_bytes": 2304,
      "reason": "block32-aligned matrix",
      "shape": [
        64,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 2048,
      "name": "blk.3.attn_q_a.weight",
      "payload_bytes": 1152,
      "reason": "block32-aligned matrix",
      "shape": [
        32,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 32,
      "name": "blk.3.attn_q_a_norm.weight",
      "payload_bytes": 64,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        32
      ],
      "type": "BF16"
    },
    {
      "elements": 2048,
      "name": "blk.3.attn_q_b.weight",
      "payload_bytes": 1152,
      "reason": "block32-aligned matrix",
      "shape": [
        64,
        32
      ],
      "type": "Q4_0"
    },
    {
      "elements": 1024,
      "name": "blk.3.attn_v_b.weight",
      "payload_bytes": 2048,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        4,
        16,
        16
      ],
      "type": "BF16"
    },
    {
      "elements": 8,
      "name": "blk.3.exp_probs_b.bias",
      "payload_bytes": 32,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        8
      ],
      "type": "F32"
    },
    {
      "elements": 16384,
      "name": "blk.3.ffn_down_exps.weight",
      "payload_bytes": 9216,
      "reason": "block32-aligned matrix",
      "shape": [
        8,
        64,
        32
      ],
      "type": "Q4_0"
    },
    {
      "elements": 2048,
      "name": "blk.3.ffn_down_shexp.weight",
      "payload_bytes": 1152,
      "reason": "block32-aligned matrix",
      "shape": [
        64,
        32
      ],
      "type": "Q4_0"
    },
    {
      "elements": 16384,
      "name": "blk.3.ffn_gate_exps.weight",
      "payload_bytes": 9216,
      "reason": "block32-aligned matrix",
      "shape": [
        8,
        32,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 512,
      "name": "blk.3.ffn_gate_inp.weight",
      "payload_bytes": 288,
      "reason": "block32-aligned matrix",
      "shape": [
        8,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 2048,
      "name": "blk.3.ffn_gate_shexp.weight",
      "payload_bytes": 1152,
      "reason": "block32-aligned matrix",
      "shape": [
        32,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 64,
      "name": "blk.3.ffn_norm.weight",
      "payload_bytes": 128,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        64
      ],
      "type": "BF16"
    },
    {
      "elements": 16384,
      "name": "blk.3.ffn_up_exps.weight",
      "payload_bytes": 9216,
      "reason": "block32-aligned matrix",
      "shape": [
        8,
        32,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 2048,
      "name": "blk.3.ffn_up_shexp.weight",
      "payload_bytes": 1152,
      "reason": "block32-aligned matrix",
      "shape": [
        32,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 1024,
      "name": "blk.3.indexer.attn_k.weight",
      "payload_bytes": 576,
      "reason": "block32-aligned matrix",
      "shape": [
        16,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 2048,
      "name": "blk.3.indexer.attn_q_b.weight",
      "payload_bytes": 1152,
      "reason": "block32-aligned matrix",
      "shape": [
        64,
        32
      ],
      "type": "Q4_0"
    },
    {
      "elements": 16,
      "name": "blk.3.indexer.k_norm.bias",
      "payload_bytes": 32,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        16
      ],
      "type": "BF16"
    },
    {
      "elements": 16,
      "name": "blk.3.indexer.k_norm.weight",
      "payload_bytes": 32,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        16
      ],
      "type": "BF16"
    },
    {
      "elements": 256,
      "name": "blk.3.indexer.proj.weight",
      "payload_bytes": 144,
      "reason": "block32-aligned matrix",
      "shape": [
        4,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 16640,
      "name": "output.weight",
      "payload_bytes": 9360,
      "reason": "block32-aligned matrix",
      "shape": [
        260,
        64
      ],
      "type": "Q4_0"
    },
    {
      "elements": 64,
      "name": "output_norm.weight",
      "payload_bytes": 128,
      "reason": "native: vector or inner dimension not divisible by 32",
      "shape": [
        64
      ],
      "type": "BF16"
    },
    {
      "elements": 16640,
      "name": "token_embd.weight",
      "payload_bytes": 9360,
      "reason": "block32-aligned matrix",
      "shape": [
        260,
        64
      ],
      "type": "Q4_0"
    }
  ],
  "format": "Q4_0",
  "gpu_kernel_validated": false,
  "license": "mit",
  "llama_cpp_runtime_validated": false,
  "own_head": true,
  "source_checkpoint_sha256": "9efe50a1685e157c1b99c3824094cf4fe269c7d332bdd0006145264949c5cec1",
  "source_repository": "malaiwah/glm-moe-dsa-tiny-random-bf16",
  "source_revision": "45563636ef723acfb826755493447dc40c7a0c37",
  "source_tensor_count": 139,
  "tokenizer_sidecars_byte_identical": true,
  "upstream_decode_parity": "all tensors exact gguf-py 0.19.0"
}

Runs of malaiwah glm-moe-dsa-tiny-random-q4_0-rtn-format on huggingface.co

88
Total runs
6
24-hour runs
4
3-day runs
1
7-day runs
34
30-day runs

More Information About glm-moe-dsa-tiny-random-q4_0-rtn-format huggingface.co Model

More glm-moe-dsa-tiny-random-q4_0-rtn-format license Visit here:

https://choosealicense.com/licenses/mit

glm-moe-dsa-tiny-random-q4_0-rtn-format huggingface.co

glm-moe-dsa-tiny-random-q4_0-rtn-format huggingface.co is an AI model on huggingface.co that provides glm-moe-dsa-tiny-random-q4_0-rtn-format's model effect (), which can be used instantly with this malaiwah glm-moe-dsa-tiny-random-q4_0-rtn-format model. huggingface.co supports a free trial of the glm-moe-dsa-tiny-random-q4_0-rtn-format model, and also provides paid use of the glm-moe-dsa-tiny-random-q4_0-rtn-format. Support call glm-moe-dsa-tiny-random-q4_0-rtn-format model through api, including Node.js, Python, http.

glm-moe-dsa-tiny-random-q4_0-rtn-format huggingface.co Url

https://huggingface.co/malaiwah/glm-moe-dsa-tiny-random-q4_0-rtn-format

malaiwah glm-moe-dsa-tiny-random-q4_0-rtn-format online free

glm-moe-dsa-tiny-random-q4_0-rtn-format huggingface.co is an online trial and call api platform, which integrates glm-moe-dsa-tiny-random-q4_0-rtn-format's modeling effects, including api services, and provides a free online trial of glm-moe-dsa-tiny-random-q4_0-rtn-format, you can try glm-moe-dsa-tiny-random-q4_0-rtn-format online for free by clicking the link below.

malaiwah glm-moe-dsa-tiny-random-q4_0-rtn-format online free url in huggingface.co:

https://huggingface.co/malaiwah/glm-moe-dsa-tiny-random-q4_0-rtn-format

glm-moe-dsa-tiny-random-q4_0-rtn-format install

glm-moe-dsa-tiny-random-q4_0-rtn-format is an open source model from GitHub that offers a free installation service, and any user can find glm-moe-dsa-tiny-random-q4_0-rtn-format on GitHub to install. At the same time, huggingface.co provides the effect of glm-moe-dsa-tiny-random-q4_0-rtn-format install, users can directly use glm-moe-dsa-tiny-random-q4_0-rtn-format installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

glm-moe-dsa-tiny-random-q4_0-rtn-format install url in huggingface.co:

https://huggingface.co/malaiwah/glm-moe-dsa-tiny-random-q4_0-rtn-format

Url of glm-moe-dsa-tiny-random-q4_0-rtn-format

glm-moe-dsa-tiny-random-q4_0-rtn-format huggingface.co Url

Provider of glm-moe-dsa-tiny-random-q4_0-rtn-format huggingface.co

malaiwah
ORGANIZATIONS
huggingface.co

Other API from malaiwah