Run them directly with
nexa-sdk
installed
In nexa-sdk CLI:
NexaAI/gemma-3-4b-it-8bit-MLX
Overview
Gemma is a family of lightweight, state-of-the-art open models from Google,
built from the same research and technology used to create the Gemini models.
Gemma 3 models are multimodal, handling text and image input and generating text
output, with open weights for both pre-trained variants and instruction-tuned
variants. Gemma 3 has a large, 128K context window, multilingual support in over
140 languages, and is available in more sizes than previous versions. Gemma 3
models are well-suited for a variety of text generation and image understanding
tasks, including question answering, summarization, and reasoning. Their
relatively small size makes it possible to deploy them in environments with
limited resources such as laptops, desktops or your own cloud infrastructure,
democratizing access to state of the art AI models and helping foster innovation
for everyone.
Inputs and outputs
Input:
Text string, such as a question, a prompt, or a document to be summarized
Images, normalized to 896 x 896 resolution and encoded to 256 tokens
each
Total input context of 128K tokens for the 4B, 12B, and 27B sizes, and
32K tokens for the 1B size
Output:
Generated text in response to the input, such as an answer to a
question, analysis of image content, or a summary of a document
Total output context of 8192 tokens
Benchmark Results
These models were evaluated against a large collection of different datasets and
metrics to cover different aspects of text generation:
gemma-3-4b-it-8bit-MLX huggingface.co is an AI model on huggingface.co that provides gemma-3-4b-it-8bit-MLX's model effect (), which can be used instantly with this NexaAI gemma-3-4b-it-8bit-MLX model. huggingface.co supports a free trial of the gemma-3-4b-it-8bit-MLX model, and also provides paid use of the gemma-3-4b-it-8bit-MLX. Support call gemma-3-4b-it-8bit-MLX model through api, including Node.js, Python, http.
gemma-3-4b-it-8bit-MLX huggingface.co is an online trial and call api platform, which integrates gemma-3-4b-it-8bit-MLX's modeling effects, including api services, and provides a free online trial of gemma-3-4b-it-8bit-MLX, you can try gemma-3-4b-it-8bit-MLX online for free by clicking the link below.
NexaAI gemma-3-4b-it-8bit-MLX online free url in huggingface.co:
gemma-3-4b-it-8bit-MLX is an open source model from GitHub that offers a free installation service, and any user can find gemma-3-4b-it-8bit-MLX on GitHub to install. At the same time, huggingface.co provides the effect of gemma-3-4b-it-8bit-MLX install, users can directly use gemma-3-4b-it-8bit-MLX installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
gemma-3-4b-it-8bit-MLX install url in huggingface.co: