prithivMLmods / gemma-4-E4B-it-F32-GGUF

huggingface.co
Total runs: 4.3K
24-hour runs: 0
7-day runs: 4.3K
30-day runs: 4.3K
Model's Last Updated: April 03 2026
image-text-to-text

Introduction of gemma-4-E4B-it-F32-GGUF

Model Details of gemma-4-E4B-it-F32-GGUF

gemma-4-E4B-it-F32-GGUF

Gemma-4-E4B-it from Google is a 4.5B effective parameter (8B total with Per-Layer Embeddings) multimodal dense model in the Gemma 4 family, optimized for edge deployment on laptops, high-end smartphones, and consumer GPUs with native support for text, images (variable aspect ratio/resolution), audio processing, and configurable thinking modes for step-by-step reasoning. Featuring 42 layers, 512-token sliding window, 128K context length, and 262K vocabulary, it delivers frontier-level performance in agentic workflows, multilingual OCR/handwriting recognition, document/PDF parsing, UI/screen analysis, chart interpretation, object detection with pointing, coding assistance, and low-latency speech-to-text understanding—rivaling models 10-20x larger while maintaining Google's production-grade safety alignments. The instruction-tuned variant excels at on-device autonomous agents via Android AICore/Qualcomm optimizations, with open weights enabling local-first inference (MediaTek/ARM CPUs, NVIDIA RTX) for privacy-focused applications like mobile IDEs, real-time document processing, and structured data extraction in resource-constrained environments.

Quick start with llama.cpp
llama-server -hf prithivMLmods/gemma-4-E4B-it-F32-GGUF:F32
Model Files
File Name Quant Type File Size File Link
gemma-4-E4B-it.BF16.gguf BF16 15.1 GB Download
gemma-4-E4B-it.F16.gguf F16 15.1 GB Download
gemma-4-E4B-it.F32.gguf F32 30.1 GB Download
gemma-4-E4B-it.Q8_0.gguf Q8_0 8.01 GB Download
gemma-4-E4B-it.mmproj-bf16.gguf mmproj-bf16 992 MB Download
gemma-4-E4B-it.mmproj-f16.gguf mmproj-f16 992 MB Download
gemma-4-E4B-it.mmproj-f32.gguf mmproj-f32 1.91 GB Download
gemma-4-E4B-it.mmproj-q8_0.gguf mmproj-q8_0 560 MB Download
Quants Usage

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):

image.png

Runs of prithivMLmods gemma-4-E4B-it-F32-GGUF on huggingface.co

4.3K
Total runs
0
24-hour runs
177
3-day runs
4.3K
7-day runs
4.3K
30-day runs

More Information About gemma-4-E4B-it-F32-GGUF huggingface.co Model

More gemma-4-E4B-it-F32-GGUF license Visit here:

https://choosealicense.com/licenses/apache-2.0

gemma-4-E4B-it-F32-GGUF huggingface.co

gemma-4-E4B-it-F32-GGUF huggingface.co is an AI model on huggingface.co that provides gemma-4-E4B-it-F32-GGUF's model effect (), which can be used instantly with this prithivMLmods gemma-4-E4B-it-F32-GGUF model. huggingface.co supports a free trial of the gemma-4-E4B-it-F32-GGUF model, and also provides paid use of the gemma-4-E4B-it-F32-GGUF. Support call gemma-4-E4B-it-F32-GGUF model through api, including Node.js, Python, http.

gemma-4-E4B-it-F32-GGUF huggingface.co Url

https://huggingface.co/prithivMLmods/gemma-4-E4B-it-F32-GGUF

prithivMLmods gemma-4-E4B-it-F32-GGUF online free

gemma-4-E4B-it-F32-GGUF huggingface.co is an online trial and call api platform, which integrates gemma-4-E4B-it-F32-GGUF's modeling effects, including api services, and provides a free online trial of gemma-4-E4B-it-F32-GGUF, you can try gemma-4-E4B-it-F32-GGUF online for free by clicking the link below.

prithivMLmods gemma-4-E4B-it-F32-GGUF online free url in huggingface.co:

https://huggingface.co/prithivMLmods/gemma-4-E4B-it-F32-GGUF

gemma-4-E4B-it-F32-GGUF install

gemma-4-E4B-it-F32-GGUF is an open source model from GitHub that offers a free installation service, and any user can find gemma-4-E4B-it-F32-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of gemma-4-E4B-it-F32-GGUF install, users can directly use gemma-4-E4B-it-F32-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

gemma-4-E4B-it-F32-GGUF install url in huggingface.co:

https://huggingface.co/prithivMLmods/gemma-4-E4B-it-F32-GGUF

Url of gemma-4-E4B-it-F32-GGUF

gemma-4-E4B-it-F32-GGUF huggingface.co Url

Provider of gemma-4-E4B-it-F32-GGUF huggingface.co

prithivMLmods
ORGANIZATIONS

Other API from prithivMLmods