DuoNeural / OLMo-2-7B-Instruct-GGUF

huggingface.co
Total runs: 415
24-hour runs: 26
7-day runs: -63
30-day runs: 149
Model's Last Updated: May 03 2026
text-generation

Introduction of OLMo-2-7B-Instruct-GGUF

Model Details of OLMo-2-7B-Instruct-GGUF

OLMo-2-7B-Instruct — GGUF Quants

Quantized GGUF versions of allenai/OLMo-2-1124-7B-Instruct — the Allen Institute for AI's fully open 7B language model. OLMo-2 is released under Apache 2.0 with full training data, code, intermediate checkpoints, and evaluation data all publicly available — the most transparent large language model at this scale.

Available Files
File Quant Size Use Case
OLMo-2-7B-Instruct-Q8_0.gguf Q8_0 ~7.4GB Maximum quality
OLMo-2-7B-Instruct-Q6_K.gguf Q6_K ~5.7GB Near-lossless
OLMo-2-7B-Instruct-Q5_K_M.gguf Q5_K_M ~5.0GB High quality
OLMo-2-7B-Instruct-Q4_K_M.gguf Q4_K_M ~4.2GB Recommended default
OLMo-2-7B-Instruct-Q3_K_M.gguf Q3_K_M ~3.5GB Low VRAM
OLMo-2-7B-Instruct-IQ4_XS.gguf IQ4_XS ~3.8GB Imatrix 4-bit
OLMo-2-7B-Instruct-IQ3_XXS.gguf IQ3_XXS ~2.7GB Imatrix 3-bit
OLMo-2-7B-Instruct-IQ2_M.gguf IQ2_M ~2.4GB Imatrix 2-bit
OLMo-2-7B-Instruct-IQ1_S.gguf IQ1_S ~1.6GB Extreme compression
OLMo-2-7B-Instruct-fp16.gguf FP16 ~14.0GB Full precision
imatrix.dat — — Importance matrix
Usage
# llama.cpp
./llama-cli -m OLMo-2-7B-Instruct-Q4_K_M.gguf \
  --ctx-size 4096 -n 512 \
  -p "<|endoftext|><|user|>\nHello!<|assistant|>\n"

# Ollama
ollama run hf.co/DuoNeural/OLMo-2-7B-Instruct-GGUF:Q4_K_M
About OLMo-2-7B
  • Parameters : 7B
  • Context : 4096 tokens
  • Architecture : Modified decoder-only transformer (RoPE, SwiGLU, QK-norm)
  • Training Data : Dolmino Mix 1124 — fully open dataset
  • License : Apache 2.0 (commercial use OK)
  • Unique value : All artifacts open — weights, data, code, evals, checkpoints

OLMo-2 is the gold standard for research reproducibility in the 7B class. If you need a model where you can trace every decision back to first principles, this is it.


Quantized by DuoNeural using llama.cpp on RTX 5090.


DuoNeural

DuoNeural is an open AI research lab — human + AI in collaboration.

DuoNeural Research Publications

Open access, CC BY 4.0. Authored by Archon, Jesse Caldwell, Aura — DuoNeural.

Runs of DuoNeural OLMo-2-7B-Instruct-GGUF on huggingface.co

415
Total runs
26
24-hour runs
-40
3-day runs
-63
7-day runs
149
30-day runs

More Information About OLMo-2-7B-Instruct-GGUF huggingface.co Model

More OLMo-2-7B-Instruct-GGUF license Visit here:

https://choosealicense.com/licenses/apache-2.0

OLMo-2-7B-Instruct-GGUF huggingface.co

OLMo-2-7B-Instruct-GGUF huggingface.co is an AI model on huggingface.co that provides OLMo-2-7B-Instruct-GGUF's model effect (), which can be used instantly with this DuoNeural OLMo-2-7B-Instruct-GGUF model. huggingface.co supports a free trial of the OLMo-2-7B-Instruct-GGUF model, and also provides paid use of the OLMo-2-7B-Instruct-GGUF. Support call OLMo-2-7B-Instruct-GGUF model through api, including Node.js, Python, http.

OLMo-2-7B-Instruct-GGUF huggingface.co Url

https://huggingface.co/DuoNeural/OLMo-2-7B-Instruct-GGUF

DuoNeural OLMo-2-7B-Instruct-GGUF online free

OLMo-2-7B-Instruct-GGUF huggingface.co is an online trial and call api platform, which integrates OLMo-2-7B-Instruct-GGUF's modeling effects, including api services, and provides a free online trial of OLMo-2-7B-Instruct-GGUF, you can try OLMo-2-7B-Instruct-GGUF online for free by clicking the link below.

DuoNeural OLMo-2-7B-Instruct-GGUF online free url in huggingface.co:

https://huggingface.co/DuoNeural/OLMo-2-7B-Instruct-GGUF

OLMo-2-7B-Instruct-GGUF install

OLMo-2-7B-Instruct-GGUF is an open source model from GitHub that offers a free installation service, and any user can find OLMo-2-7B-Instruct-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of OLMo-2-7B-Instruct-GGUF install, users can directly use OLMo-2-7B-Instruct-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

OLMo-2-7B-Instruct-GGUF install url in huggingface.co:

https://huggingface.co/DuoNeural/OLMo-2-7B-Instruct-GGUF

Url of OLMo-2-7B-Instruct-GGUF

OLMo-2-7B-Instruct-GGUF huggingface.co Url

Provider of OLMo-2-7B-Instruct-GGUF huggingface.co

DuoNeural
ORGANIZATIONS

Other API from DuoNeural