prithivMLmods / gemma-4-12B-it-GGUF

huggingface.co
Total runs: 2.1K
24-hour runs: 0
7-day runs: 276
30-day runs: 1.6K
Model's Last Updated: June 07 2026
image-text-to-text

Introduction of gemma-4-12B-it-GGUF

Model Details of gemma-4-12B-it-GGUF

gemma-4-12B-it-GGUF

google/gemma-4-12B-it from Google DeepMind is a 12B-parameter unified, encoder-free multimodal model released June 3, 2026, as the first mid-sized Gemma 4 to feature native audio inputs alongside text, image, and video, processing all modalities by flowing directly into the LLM backbone without separate vision/audio encoders for reduced latency and memory footprint. It delivers performance nearing Gemma 4 26B MoE on standard benchmarks while requiring less than half the total memory (~16GB VRAM or unified memory), making it laptop-ready for consumer hardware with 16GB RAM, Multi-Token Prediction (MTP) drafters for lower latency, and strong agentic reasoning for multi-step workflows. Released under Apache 2.0 with support across the developer ecosystem (Ollama, vLLM, LM Studio), Gemma 4 12B excels at real-time audio/visual understanding, image analysis, content categorization, context compression, and local-first AI applications without API dependency.

Model Files
File Name Quant Type File Size File Link
gemma-4-12B-it.BF16.gguf BF16 23.8 GB Download
gemma-4-12B-it.F16.gguf F16 23.8 GB Download
gemma-4-12B-it.Q2_K.gguf Q2_K 4.83 GB Download
gemma-4-12B-it.Q3_K_L.gguf Q3_K_L 6.57 GB Download
gemma-4-12B-it.Q3_K_M.gguf Q3_K_M 6.09 GB Download
gemma-4-12B-it.Q3_K_S.gguf Q3_K_S 5.53 GB Download
gemma-4-12B-it.Q4_0.gguf Q4_0 6.98 GB Download
gemma-4-12B-it.Q4_K_M.gguf Q4_K_M 7.38 GB Download
gemma-4-12B-it.Q4_K_S.gguf Q4_K_S 7.02 GB Download
gemma-4-12B-it.Q5_0.gguf Q5_0 8.34 GB Download
gemma-4-12B-it.Q5_K_M.gguf Q5_K_M 8.55 GB Download
gemma-4-12B-it.Q5_K_S.gguf Q5_K_S 8.34 GB Download
gemma-4-12B-it.Q6_K.gguf Q6_K 9.79 GB Download
gemma-4-12B-it.Q8_0.gguf Q8_0 12.7 GB Download
gemma-4-12B-it.mmproj-bf16.gguf mmproj-bf16 175 MB Download
gemma-4-12B-it.mmproj-f16.gguf mmproj-f16 175 MB Download
gemma-4-12B-it.mmproj-q8_0.gguf mmproj-q8_0 159 MB Download
llama.cpp

LLM inference in C/C++ — https://github.com/ggml-org/llama.cpp

Runs of prithivMLmods gemma-4-12B-it-GGUF on huggingface.co

2.1K
Total runs
0
24-hour runs
149
3-day runs
276
7-day runs
1.6K
30-day runs

More Information About gemma-4-12B-it-GGUF huggingface.co Model

More gemma-4-12B-it-GGUF license Visit here:

https://choosealicense.com/licenses/apache-2.0

gemma-4-12B-it-GGUF huggingface.co

gemma-4-12B-it-GGUF huggingface.co is an AI model on huggingface.co that provides gemma-4-12B-it-GGUF's model effect (), which can be used instantly with this prithivMLmods gemma-4-12B-it-GGUF model. huggingface.co supports a free trial of the gemma-4-12B-it-GGUF model, and also provides paid use of the gemma-4-12B-it-GGUF. Support call gemma-4-12B-it-GGUF model through api, including Node.js, Python, http.

prithivMLmods gemma-4-12B-it-GGUF online free

gemma-4-12B-it-GGUF huggingface.co is an online trial and call api platform, which integrates gemma-4-12B-it-GGUF's modeling effects, including api services, and provides a free online trial of gemma-4-12B-it-GGUF, you can try gemma-4-12B-it-GGUF online for free by clicking the link below.

prithivMLmods gemma-4-12B-it-GGUF online free url in huggingface.co:

https://huggingface.co/prithivMLmods/gemma-4-12B-it-GGUF

gemma-4-12B-it-GGUF install

gemma-4-12B-it-GGUF is an open source model from GitHub that offers a free installation service, and any user can find gemma-4-12B-it-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of gemma-4-12B-it-GGUF install, users can directly use gemma-4-12B-it-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

gemma-4-12B-it-GGUF install url in huggingface.co:

https://huggingface.co/prithivMLmods/gemma-4-12B-it-GGUF

Url of gemma-4-12B-it-GGUF

gemma-4-12B-it-GGUF huggingface.co Url

Provider of gemma-4-12B-it-GGUF huggingface.co

prithivMLmods
ORGANIZATIONS

Other API from prithivMLmods