Gemory-26B-A4B is a 26-billion parameter Mixture of Experts (MoE) model built on the Gemma architecture foundation, fine-tuned for high-fidelity creative writing, unrestricted roleplay, and complex multi-turn conversational depth. All quantizations were generated directly from the uncompressed 50.5 GB
BF16
base model and sanity-tested for generation integrity.
Quantization Breakdown
Filename
Quant Method
File Size
Recommended RAM/VRAM
Description / Quality
Gemory-26B-A4B-Q6_K.gguf
Q6_K
22.6 GB
~26 GB+
Near-lossless quality; closest output to base BF16 weights.
Gemory-26B-A4B-Q5_K_M.gguf
Q5_K_M
19.1 GB
~23 GB+
High quality; recommended sweet spot for 24 GB VRAM GPUs.
Gemory-26B-A4B-Q5_K_S.gguf
Q5_K_S
18.0 GB
~22 GB+
High quality with slightly faster inference and lower memory.
Gemory-26B-A4B-Q4_K_M.gguf
Q4_K_M
16.8 GB
~20 GB+
Default Recommended
: Optimal balance of speed, perplexity, and memory.
Gemory-26B-A4B-Q4_K_S.gguf
Q4_K_S
15.5 GB
~19 GB+
Standard 4-bit quantization for tighter memory envelopes.
Gemory-26B-A4B-GGUF huggingface.co is an AI model on huggingface.co that provides Gemory-26B-A4B-GGUF's model effect (), which can be used instantly with this Abiray Gemory-26B-A4B-GGUF model. huggingface.co supports a free trial of the Gemory-26B-A4B-GGUF model, and also provides paid use of the Gemory-26B-A4B-GGUF. Support call Gemory-26B-A4B-GGUF model through api, including Node.js, Python, http.
Gemory-26B-A4B-GGUF huggingface.co is an online trial and call api platform, which integrates Gemory-26B-A4B-GGUF's modeling effects, including api services, and provides a free online trial of Gemory-26B-A4B-GGUF, you can try Gemory-26B-A4B-GGUF online for free by clicking the link below.
Abiray Gemory-26B-A4B-GGUF online free url in huggingface.co:
Gemory-26B-A4B-GGUF is an open source model from GitHub that offers a free installation service, and any user can find Gemory-26B-A4B-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of Gemory-26B-A4B-GGUF install, users can directly use Gemory-26B-A4B-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
Gemory-26B-A4B-GGUF install url in huggingface.co: