Note: There is no license listed on the source model at the time this readme was created. Assume it's apache, but cannot be sure. Ask Drummer or BeaverAI directly if you need to know.
This is a custom Q6_K quant of
https://huggingface.co/BeaverAI/Spectre-37B-v1a-GGUF
which is an upscale of Gemma 4 31B.
We take no credit for this model. This is just a quant.
I tore out the Q8 embedding layer from the Q8 quant and placed it into the Q6_K quant. This is the only change.
This adds around 500MB size/vram usage to the Q6 quant.
In my experience the Q8 embedding layer runs circles around the Q6 embedding layer when it comes to roleplay. YMMV!