darkmaniac7 / Gemma-4-E2B-it-MNN

huggingface.co
Total runs: 682
24-hour runs: 0
7-day runs: 1
30-day runs: 238
Model's Last Updated: May 01 2026
text-generation

Introduction of Gemma-4-E2B-it-MNN

Model Details of Gemma-4-E2B-it-MNN

Gemma-4-E2B-it-MNN

Pre-converted google/gemma-4-E2B-it in MNN format for TokForge on-device inference.

Requires TokForge 3.4.9 or later .

These Gemma 4 bundles depend on the updated TokForge 3.4.9 runtime and patched libMNN.so with Gemma 4 attention-scale support. Older TokForge builds such as 3.4.7 and pre-patched 3.4.9 builds are not compatible.

What This Repo Contains

This repo ships the working TokForge bundle layout:

File Purpose
llm.mnn MNN graph
llm.mnn.weight Quantized weights
llm.mnn.json Graph metadata
llm_config.json Runtime config and chat template
config.json TokForge backend defaults
embeddings_int4.bin Token embeddings
per_layer_embeddings_int4.bin Per-layer embeddings
tokenizer.txt / tokenizer.mtok Tokenizer assets

The bundle is configured for TokForge's CPU lane and ships the verified Gemma 4 runtime settings, including attn_scale: 1.0 and force_full_decode_recompute: false .

Validation

Validated in TokForge 3.4.9 benchmark and chat runs:

  • Coherent at 128 tokens on Lenovo 16GB.
  • Coherent long-form run on RedMagic 24GB.
  • RedMagic long-form decode observed at about 27 tok/s on the verified app lane.

CPU is the recommended backend for Gemma 4 in TokForge. For E2B, keep MNN precision at normal or high ; low precision can produce degenerate prompt-parrot output.

Usage
  1. Update TokForge to 3.4.9 or later.
  2. Add model repo darkmaniac7/Gemma-4-E2B-it-MNN .
  3. Use the CPU backend.
  4. Set MNN precision to normal or high .
  5. Chat normally. Avoid low precision on E2B.
Attribution

Runs of darkmaniac7 Gemma-4-E2B-it-MNN on huggingface.co

682
Total runs
0
24-hour runs
0
3-day runs
1
7-day runs
238
30-day runs

More Information About Gemma-4-E2B-it-MNN huggingface.co Model

More Gemma-4-E2B-it-MNN license Visit here:

https://choosealicense.com/licenses/apache-2.0

Gemma-4-E2B-it-MNN huggingface.co

Gemma-4-E2B-it-MNN huggingface.co is an AI model on huggingface.co that provides Gemma-4-E2B-it-MNN's model effect (), which can be used instantly with this darkmaniac7 Gemma-4-E2B-it-MNN model. huggingface.co supports a free trial of the Gemma-4-E2B-it-MNN model, and also provides paid use of the Gemma-4-E2B-it-MNN. Support call Gemma-4-E2B-it-MNN model through api, including Node.js, Python, http.

Gemma-4-E2B-it-MNN huggingface.co Url

https://huggingface.co/darkmaniac7/Gemma-4-E2B-it-MNN

darkmaniac7 Gemma-4-E2B-it-MNN online free

Gemma-4-E2B-it-MNN huggingface.co is an online trial and call api platform, which integrates Gemma-4-E2B-it-MNN's modeling effects, including api services, and provides a free online trial of Gemma-4-E2B-it-MNN, you can try Gemma-4-E2B-it-MNN online for free by clicking the link below.

darkmaniac7 Gemma-4-E2B-it-MNN online free url in huggingface.co:

https://huggingface.co/darkmaniac7/Gemma-4-E2B-it-MNN

Gemma-4-E2B-it-MNN install

Gemma-4-E2B-it-MNN is an open source model from GitHub that offers a free installation service, and any user can find Gemma-4-E2B-it-MNN on GitHub to install. At the same time, huggingface.co provides the effect of Gemma-4-E2B-it-MNN install, users can directly use Gemma-4-E2B-it-MNN installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Gemma-4-E2B-it-MNN install url in huggingface.co:

https://huggingface.co/darkmaniac7/Gemma-4-E2B-it-MNN

Url of Gemma-4-E2B-it-MNN

Gemma-4-E2B-it-MNN huggingface.co Url

Provider of Gemma-4-E2B-it-MNN huggingface.co

darkmaniac7
ORGANIZATIONS

Other API from darkmaniac7