Sponsored by PostMcpAi
Toolify Toolify logo
AI Models
Qwen3-Embedding-8B-GGUF

JonathanMiddleton / Qwen3-Embedding-8B-GGUF

Run on huggingface.co
huggingface.co
Total runs: 812
24-hour runs: 0
7-day runs: 94
30-day runs: 91
Model's Last Updated: July 14 2025

Introduction of Qwen3-Embedding-8B-GGUF

Model Details of Qwen3-Embedding-8B-GGUF

Qwen3-Embedding-8B-GGUF

Purpose

Multilingual text-embedding model in GGUF format for efficient CPU/GPU inference with llama.cpp and derivatives.

Files
Filename Precision Size* Est. MTEB Δ vs FP16 Notes
Qwen3-Embedding-8B-F16.gguf FP16 15.1 GB 0 Direct conversion; reference quality
Qwen3-Embedding-8B-Q8_0.gguf Q8_0 8.6 GB ≈ +0.02 Full-precision parity for most tasks
Qwen3-Embedding-8B-Q6_K.gguf Q6_K 6.9 GB ≈ +0.20 Balanced size / quality
Qwen3-Embedding-8B-Q5_K_M.gguf Q5_K_M 6.16 GB ≈ +0.35 Good recall under tight memory
Qwen3-Embedding-8B-Q4_K_M.gguf Q4_K_M 5.41 GB ≈ +0.60 Lowest-size CPU-friendly build
Upstream source
Conversion
  • Code base : llama.cpp commit a20f0a1 + PR #14029 (Qwen embedding support).
  • Command: 
    python convert_hf_to_gguf.py Qwen/Qwen3-Embedding-8B \
      --outfile Qwen3-Embedding-8B-F16.gguf \
      --leave-output-tensor \
      --outtype f16


BASE=$(basename "${SRC%.*}")  
DIR=$(dirname "$SRC")

EMB_OPT="--token-embedding-type F16 --leave-output-tensor"

for QT in Q4_K_M Q5_K_M Q6_K Q8_0; do
  OUT="${DIR}/${BASE}-${QT}.gguf"
  echo ">> quantising ${QT}  ->  $(basename "$OUT")"
  llama-quantize $EMB_OPT "$SRC" "$OUT" "$QT" $(nproc)
done

Runs of JonathanMiddleton Qwen3-Embedding-8B-GGUF on huggingface.co

812
Total runs
0
24-hour runs
0
3-day runs
94
7-day runs
91
30-day runs

More Information About Qwen3-Embedding-8B-GGUF huggingface.co Model

More Qwen3-Embedding-8B-GGUF license Visit here:

https://choosealicense.com/licenses/apache-2.0

Qwen3-Embedding-8B-GGUF huggingface.co

Qwen3-Embedding-8B-GGUF huggingface.co is an AI model on huggingface.co that provides Qwen3-Embedding-8B-GGUF's model effect (), which can be used instantly with this JonathanMiddleton Qwen3-Embedding-8B-GGUF model. huggingface.co supports a free trial of the Qwen3-Embedding-8B-GGUF model, and also provides paid use of the Qwen3-Embedding-8B-GGUF. Support call Qwen3-Embedding-8B-GGUF model through api, including Node.js, Python, http.

Qwen3-Embedding-8B-GGUF huggingface.co Url

https://huggingface.co/JonathanMiddleton/Qwen3-Embedding-8B-GGUF

JonathanMiddleton Qwen3-Embedding-8B-GGUF online free

Qwen3-Embedding-8B-GGUF huggingface.co is an online trial and call api platform, which integrates Qwen3-Embedding-8B-GGUF's modeling effects, including api services, and provides a free online trial of Qwen3-Embedding-8B-GGUF, you can try Qwen3-Embedding-8B-GGUF online for free by clicking the link below.

JonathanMiddleton Qwen3-Embedding-8B-GGUF online free url in huggingface.co:

https://huggingface.co/JonathanMiddleton/Qwen3-Embedding-8B-GGUF

Qwen3-Embedding-8B-GGUF install

Qwen3-Embedding-8B-GGUF is an open source model from GitHub that offers a free installation service, and any user can find Qwen3-Embedding-8B-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of Qwen3-Embedding-8B-GGUF install, users can directly use Qwen3-Embedding-8B-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Qwen3-Embedding-8B-GGUF install url in huggingface.co:

https://huggingface.co/JonathanMiddleton/Qwen3-Embedding-8B-GGUF

Url of Qwen3-Embedding-8B-GGUF

Provider of Qwen3-Embedding-8B-GGUF huggingface.co

JonathanMiddleton
ORGANIZATIONS
huggingface.co

Other API from JonathanMiddleton