Run
Granite-4.0-Micro
optimized for
Qualcomm NPUs
with
nexaSDK
.
Quickstart
Install NexaSDK
and create a free account at
sdk.nexa.ai
Activate your device
with your access token:
nexa config set license '<access_token>'
Run the model on Qualcomm NPU in one line:
nexa infer NexaAI/Granite-4-Micro-NPU
Model Description
Granite-4.0-Micro
is a 3B parameter instruction-tuned model in the Granite 4.0 family, developed by IBM.
It’s optimized for
long-context reasoning (128K tokens)
, efficient inference, and enterprise-ready capabilities such as tool calling and retrieval-augmented generation. The model balances compact size with strong performance across general NLP tasks, making it suitable for both experimentation and production workloads.
Features
Compact transformer architecture
: 3B parameters with GQA, RoPE, SwiGLU, and RMSNorm layers.
Instruction-following & tool calling
: Tuned with supervised finetuning, alignment (RLHF), and model merging for robust enterprise tasks.
Multilingual support
: Covers 12+ languages including English, German, Spanish, French, Japanese, Korean, Arabic, and Chinese.
Extended context window
: Supports sequences up to
128K tokens
for long-form reasoning.
Use Cases
Conversational AI and virtual assistants.
Enterprise applications needing
tool/API calling
and structured outputs.
Long-document summarization, classification, and extraction.
Retrieval-augmented generation (RAG) for knowledge-intensive workflows.
Lightweight coding assistants and multilingual dialog systems.
Inputs and Outputs
Input
: Natural language text prompts, chat conversations, or tool-augmented requests.
Output
: Natural language responses—answers, explanations, summaries, structured JSON for function calls, or code snippets.
License
Licensed under
Apache 2.0
Runs of NexaAI Granite-4-Micro-NPU on huggingface.co
20
Total runs
0
24-hour runs
-3
3-day runs
2
7-day runs
2
30-day runs
More Information About Granite-4-Micro-NPU huggingface.co Model
Granite-4-Micro-NPU huggingface.co
Granite-4-Micro-NPU huggingface.co is an AI model on huggingface.co that provides Granite-4-Micro-NPU's model effect (), which can be used instantly with this NexaAI Granite-4-Micro-NPU model. huggingface.co supports a free trial of the Granite-4-Micro-NPU model, and also provides paid use of the Granite-4-Micro-NPU. Support call Granite-4-Micro-NPU model through api, including Node.js, Python, http.
Granite-4-Micro-NPU huggingface.co is an online trial and call api platform, which integrates Granite-4-Micro-NPU's modeling effects, including api services, and provides a free online trial of Granite-4-Micro-NPU, you can try Granite-4-Micro-NPU online for free by clicking the link below.
NexaAI Granite-4-Micro-NPU online free url in huggingface.co:
Granite-4-Micro-NPU is an open source model from GitHub that offers a free installation service, and any user can find Granite-4-Micro-NPU on GitHub to install. At the same time, huggingface.co provides the effect of Granite-4-Micro-NPU install, users can directly use Granite-4-Micro-NPU installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
Granite-4-Micro-NPU install url in huggingface.co: