Abiray / Gemory-26B-A4B-GGUF

huggingface.co
Total runs: 4.9K
24-hour runs: 215
7-day runs: 1.3K
30-day runs: 4.6K
Model's Last Updated: September 14 2026
text-generation

Introduction of Gemory-26B-A4B-GGUF

Model Details of Gemory-26B-A4B-GGUF

Gemory-26B-A4B - GGUF

This repository contains GGUF quantizations of UltimateIntent/Gemory-26B-A4B-GGUF .

Gemory-26B-A4B is a 26-billion parameter Mixture of Experts (MoE) model built on the Gemma architecture foundation, fine-tuned for high-fidelity creative writing, unrestricted roleplay, and complex multi-turn conversational depth. All quantizations were generated directly from the uncompressed 50.5 GB BF16 base model and sanity-tested for generation integrity.


Quantization Breakdown
Filename Quant Method File Size Recommended RAM/VRAM Description / Quality
Gemory-26B-A4B-Q6_K.gguf Q6_K 22.6 GB ~26 GB+ Near-lossless quality; closest output to base BF16 weights.
Gemory-26B-A4B-Q5_K_M.gguf Q5_K_M 19.1 GB ~23 GB+ High quality; recommended sweet spot for 24 GB VRAM GPUs.
Gemory-26B-A4B-Q5_K_S.gguf Q5_K_S 18.0 GB ~22 GB+ High quality with slightly faster inference and lower memory.
Gemory-26B-A4B-Q4_K_M.gguf Q4_K_M 16.8 GB ~20 GB+ Default Recommended : Optimal balance of speed, perplexity, and memory.
Gemory-26B-A4B-Q4_K_S.gguf Q4_K_S 15.5 GB ~19 GB+ Standard 4-bit quantization for tighter memory envelopes.
Gemory-26B-A4B-Q3_K_M.gguf Q3_K_M 13.3 GB ~16 GB+ Low-memory 3-bit variant; preserves critical attention weights.
Gemory-26B-A4B-Q3_K_S.gguf Q3_K_S 12.2 GB ~15 GB+ Maximum compression; fits easily on 16 GB systems.

Usage Instructions
1. llama.cpp

Command-Line Inference ( llama-cli ):

./llama-cli \
  -hf Abiray/Gemory-26B-A4B-GGUF:Q4_K_M \
  -p "Write an opening scene set in a rain-soaked neon alleyway." \
  -n 512 \
  --temp 0.7

Runs of Abiray Gemory-26B-A4B-GGUF on huggingface.co

4.9K
Total runs
215
24-hour runs
446
3-day runs
1.3K
7-day runs
4.6K
30-day runs

More Information About Gemory-26B-A4B-GGUF huggingface.co Model

More Gemory-26B-A4B-GGUF license Visit here:

https://choosealicense.com/licenses/apache-2.0

Gemory-26B-A4B-GGUF huggingface.co

Gemory-26B-A4B-GGUF huggingface.co is an AI model on huggingface.co that provides Gemory-26B-A4B-GGUF's model effect (), which can be used instantly with this Abiray Gemory-26B-A4B-GGUF model. huggingface.co supports a free trial of the Gemory-26B-A4B-GGUF model, and also provides paid use of the Gemory-26B-A4B-GGUF. Support call Gemory-26B-A4B-GGUF model through api, including Node.js, Python, http.

Gemory-26B-A4B-GGUF huggingface.co Url

https://huggingface.co/Abiray/Gemory-26B-A4B-GGUF

Abiray Gemory-26B-A4B-GGUF online free

Gemory-26B-A4B-GGUF huggingface.co is an online trial and call api platform, which integrates Gemory-26B-A4B-GGUF's modeling effects, including api services, and provides a free online trial of Gemory-26B-A4B-GGUF, you can try Gemory-26B-A4B-GGUF online for free by clicking the link below.

Abiray Gemory-26B-A4B-GGUF online free url in huggingface.co:

https://huggingface.co/Abiray/Gemory-26B-A4B-GGUF

Gemory-26B-A4B-GGUF install

Gemory-26B-A4B-GGUF is an open source model from GitHub that offers a free installation service, and any user can find Gemory-26B-A4B-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of Gemory-26B-A4B-GGUF install, users can directly use Gemory-26B-A4B-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Gemory-26B-A4B-GGUF install url in huggingface.co:

https://huggingface.co/Abiray/Gemory-26B-A4B-GGUF

Url of Gemory-26B-A4B-GGUF

Gemory-26B-A4B-GGUF huggingface.co Url

Provider of Gemory-26B-A4B-GGUF huggingface.co

Abiray
ORGANIZATIONS

Other API from Abiray

huggingface.co

Total runs: 242.5K
Run Growth: -732.2K
Growth Rate: -273.70%
Updated:August 08 2026
huggingface.co

Total runs: 7.5K
Run Growth: 3.1K
Growth Rate: 56.50%
Updated:June 15 2026
huggingface.co

Total runs: 4.1K
Run Growth: -2.5K
Growth Rate: -59.72%
Updated:July 14 2026
huggingface.co

Total runs: 2.1K
Run Growth: 1.9K
Growth Rate: 81.01%
Updated:September 13 2026
huggingface.co

Total runs: 1.7K
Run Growth: -203
Growth Rate: -11.44%
Updated:May 16 2026