DuoNeural / Ministral-8B-Instruct-GGUF

huggingface.co
Total runs: 276
24-hour runs: -1
7-day runs: -60
30-day runs: 153
Model's Last Updated: May 03 2026
text-generation

Introduction of Ministral-8B-Instruct-GGUF

Model Details of Ministral-8B-Instruct-GGUF

Ministral-8B-Instruct — GGUF Quants

Quantized GGUF versions of mistralai/Ministral-8B-Instruct-2410 — Mistral AI's Ministral 8B instruct model, optimized for edge and on-device deployment. Features sliding window attention for efficient long-context processing.

Available Files
File Quant Size Use Case
Ministral-8B-Instruct-Q8_0.gguf Q8_0 ~8.5GB Maximum quality
Ministral-8B-Instruct-Q6_K.gguf Q6_K ~6.6GB Near-lossless
Ministral-8B-Instruct-Q5_K_M.gguf Q5_K_M ~5.7GB High quality
Ministral-8B-Instruct-Q4_K_M.gguf Q4_K_M ~4.9GB Recommended default
Ministral-8B-Instruct-Q3_K_M.gguf Q3_K_M ~3.9GB Low VRAM
Ministral-8B-Instruct-IQ4_XS.gguf IQ4_XS ~4.3GB Imatrix 4-bit
Ministral-8B-Instruct-IQ3_XXS.gguf IQ3_XXS ~3.2GB Imatrix 3-bit
Ministral-8B-Instruct-IQ2_M.gguf IQ2_M ~2.8GB Imatrix 2-bit
Ministral-8B-Instruct-IQ1_S.gguf IQ1_S ~2.0GB Extreme compression
Ministral-8B-Instruct-fp16.gguf FP16 ~16.0GB Full precision
imatrix.dat — — Importance matrix
Usage
./llama-cli -m Ministral-8B-Instruct-Q4_K_M.gguf \
  --ctx-size 8192 -n 512 \
  -p "[INST] Hello! [/INST]"

ollama run hf.co/DuoNeural/Ministral-8B-Instruct-GGUF:Q4_K_M
  • Parameters : 8B | License : Apache 2.0 | Context : 32K (SWA)

Quantized by DuoNeural using llama.cpp on RTX 5090.


DuoNeural

DuoNeural is an open AI research lab — human + AI in collaboration.

DuoNeural Research Publications

Open access, CC BY 4.0. Authored by Archon, Jesse Caldwell, Aura — DuoNeural.

Runs of DuoNeural Ministral-8B-Instruct-GGUF on huggingface.co

276
Total runs
-1
24-hour runs
-77
3-day runs
-60
7-day runs
153
30-day runs

More Information About Ministral-8B-Instruct-GGUF huggingface.co Model

More Ministral-8B-Instruct-GGUF license Visit here:

https://choosealicense.com/licenses/apache-2.0

Ministral-8B-Instruct-GGUF huggingface.co

Ministral-8B-Instruct-GGUF huggingface.co is an AI model on huggingface.co that provides Ministral-8B-Instruct-GGUF's model effect (), which can be used instantly with this DuoNeural Ministral-8B-Instruct-GGUF model. huggingface.co supports a free trial of the Ministral-8B-Instruct-GGUF model, and also provides paid use of the Ministral-8B-Instruct-GGUF. Support call Ministral-8B-Instruct-GGUF model through api, including Node.js, Python, http.

Ministral-8B-Instruct-GGUF huggingface.co Url

https://huggingface.co/DuoNeural/Ministral-8B-Instruct-GGUF

DuoNeural Ministral-8B-Instruct-GGUF online free

Ministral-8B-Instruct-GGUF huggingface.co is an online trial and call api platform, which integrates Ministral-8B-Instruct-GGUF's modeling effects, including api services, and provides a free online trial of Ministral-8B-Instruct-GGUF, you can try Ministral-8B-Instruct-GGUF online for free by clicking the link below.

DuoNeural Ministral-8B-Instruct-GGUF online free url in huggingface.co:

https://huggingface.co/DuoNeural/Ministral-8B-Instruct-GGUF

Ministral-8B-Instruct-GGUF install

Ministral-8B-Instruct-GGUF is an open source model from GitHub that offers a free installation service, and any user can find Ministral-8B-Instruct-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of Ministral-8B-Instruct-GGUF install, users can directly use Ministral-8B-Instruct-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Ministral-8B-Instruct-GGUF install url in huggingface.co:

https://huggingface.co/DuoNeural/Ministral-8B-Instruct-GGUF

Url of Ministral-8B-Instruct-GGUF

Ministral-8B-Instruct-GGUF huggingface.co Url

Provider of Ministral-8B-Instruct-GGUF huggingface.co

DuoNeural
ORGANIZATIONS

Other API from DuoNeural