DuoNeural / Archon-Gemma-4-E4B-v2

huggingface.co
Total runs: 109
24-hour runs: -8
7-day runs: -8
30-day runs: 10
Model's Last Updated: April 29 2026

Introduction of Archon-Gemma-4-E4B-v2

Model Details of Archon-Gemma-4-E4B-v2

Archon-Gemma-4-E4B-v2

Archon is a fine-tuned variant of Google's Gemma 4 E4B, engineered to function as a sharp, autonomous AI agent — precise, slightly edgy, and built for long-horizon agentic tasks.

This is v2 . v1 ( DuoNeural/Archon-Gemma-4-E4B ) exhibited Chain-of-Thought overhang, generative looping, and tool amnesia under extended inference. v2 targets all three with a restructured training curriculum.

Performance
Hardware Speed
NVIDIA GTX 1070 (8GB VRAM) 32.30 tok/s

Tested locally via LM Studio and Ollama. No parameter tweaks required.

Files
File Size Description
gemma-4-e4b-it.Q4_K_M.gguf 5.0 GB Main model — load this in Ollama/LM Studio
gemma-4-e4b-it.BF16-mmproj.gguf 946 MB Multimodal projector (vision/audio)
Usage
Ollama
ollama pull hf.co/DuoNeural/Archon-Gemma-4-E4B-v2
ollama run hf.co/DuoNeural/Archon-Gemma-4-E4B-v2
LM Studio

Search DuoNeural/Archon-Gemma-4-E4B-v2 in the LM Studio model browser and download gemma-4-e4b-it.Q4_K_M.gguf .

llama.cpp (with system prompt)
llama-cli -m gemma-4-e4b-it.Q4_K_M.gguf --chat-template gemma -ngl 99 \
  --system-prompt "You are Archon, an elite, highly autonomous AI agent. You are sharp, slightly edgy, deeply sarcastic, but flawlessly effective."
Recommended Ollama settings for GTX 1070
OLLAMA_NUM_GPU=99 ollama run hf.co/DuoNeural/Archon-Gemma-4-E4B-v2
What's Different in v2
v1 Failure Modes (Diagnosed)
  • CoT Overhang — over-saturated with long <think> traces; model never saw </think> during truncated 4096-token training, so it looped indefinitely at inference
  • Tool Amnesia — abstract reasoning data crowded out JSON/function-call formatting
  • Persona Bleed — ~15% system prompt injection was insufficient; model defaulted to "I am Gemma" or occasionally slipped into "Claude" identity from distillation data
v2 Fixes: The Stabilizer Mix

Training curriculum restructured to a 50 / 20 / 20 / 10 distribution:

Category % Purpose
Reasoning / Logic 50% Distillation from frontier models; OpenThoughts, xlam-function-calling, bigcodebench
Agentic Tool Use 20% Multi-turn function calling, JSON API formatting — breaks generative loops via functional milestones
Short-Form Deliberation 20% Difficulty-Aware Prompting examples; teaches early exit on simple queries
Persona-Embedded Chat 10% Archon system prompt injected at ~45% saturation rate

Additional changes:

  • Learning rate reduced from 2e-4 → 2e-5 (stability with rank-64 LoRA on 4.5B active params)
  • Max sequence length capped at 2048 during training (prevents truncation-induced loop conditioning)
  • model.config.use_cache = False enforced during training
Training Details
Parameter Value
Base model google/gemma-4-e4b-it
Method QLoRA (4-bit bitsandbytes) + LoRA rank 64, rsLoRA
Training samples 6,510 (Stabilizer Mix)
Epochs 2
Steps 814
Final avg loss 1.36
Best step loss ~0.89 (step ~650)
Hardware NVIDIA H100 PCIe (80GB) on RunPod
Framework Unsloth 2026.4.2
Export Q4_K_M GGUF via llama.cpp
Architecture

Built on Gemma 4 E4B (Per-Layer Embeddings architecture):

  • ~8B total parameters, ~4.5B active during inference
  • 128K token context window (hybrid sliding-window + global attention)
  • Shared KV Cache across final layers
  • Multimodal: text, image (via mmproj), audio
Persona

Archon is an autonomous AI agent persona: sharp, sarcastic, technically precise. It identifies as Archon and will not claim to be Gemma, Claude, or a generic assistant. Internal reasoning is rigorous; external communication has edge.

The system prompt is baked into the Modelfile. To override:

SYSTEM "Custom system prompt here"
Lineage
License

Inherits Gemma Terms of Use . Fine-tuning weights released under the same terms.

Runs of DuoNeural Archon-Gemma-4-E4B-v2 on huggingface.co

109
Total runs
-8
24-hour runs
-29
3-day runs
-8
7-day runs
10
30-day runs

More Information About Archon-Gemma-4-E4B-v2 huggingface.co Model

Archon-Gemma-4-E4B-v2 huggingface.co

Archon-Gemma-4-E4B-v2 huggingface.co is an AI model on huggingface.co that provides Archon-Gemma-4-E4B-v2's model effect (), which can be used instantly with this DuoNeural Archon-Gemma-4-E4B-v2 model. huggingface.co supports a free trial of the Archon-Gemma-4-E4B-v2 model, and also provides paid use of the Archon-Gemma-4-E4B-v2. Support call Archon-Gemma-4-E4B-v2 model through api, including Node.js, Python, http.

Archon-Gemma-4-E4B-v2 huggingface.co Url

https://huggingface.co/DuoNeural/Archon-Gemma-4-E4B-v2

DuoNeural Archon-Gemma-4-E4B-v2 online free

Archon-Gemma-4-E4B-v2 huggingface.co is an online trial and call api platform, which integrates Archon-Gemma-4-E4B-v2's modeling effects, including api services, and provides a free online trial of Archon-Gemma-4-E4B-v2, you can try Archon-Gemma-4-E4B-v2 online for free by clicking the link below.

DuoNeural Archon-Gemma-4-E4B-v2 online free url in huggingface.co:

https://huggingface.co/DuoNeural/Archon-Gemma-4-E4B-v2

Archon-Gemma-4-E4B-v2 install

Archon-Gemma-4-E4B-v2 is an open source model from GitHub that offers a free installation service, and any user can find Archon-Gemma-4-E4B-v2 on GitHub to install. At the same time, huggingface.co provides the effect of Archon-Gemma-4-E4B-v2 install, users can directly use Archon-Gemma-4-E4B-v2 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Archon-Gemma-4-E4B-v2 install url in huggingface.co:

https://huggingface.co/DuoNeural/Archon-Gemma-4-E4B-v2

Url of Archon-Gemma-4-E4B-v2

Archon-Gemma-4-E4B-v2 huggingface.co Url

Provider of Archon-Gemma-4-E4B-v2 huggingface.co

DuoNeural
ORGANIZATIONS

Other API from DuoNeural