mudler / Step-3.5-Flash-APEX-GGUF

huggingface.co
Total runs: 1.6K
24-hour runs: 30
7-day runs: -131
30-day runs: -300
Model's Last Updated: August 17 2026

Introduction of Step-3.5-Flash-APEX-GGUF

Model Details of Step-3.5-Flash-APEX-GGUF

Step-3.5-Flash APEX GGUF

APEX (Adaptive Precision for EXpert Models) quantizations of Step-3.5-Flash .

Brought to you by the LocalAI team | APEX Project | Technical Report

Benchmark Results

Benchmarks coming soon. For reference APEX benchmarks on the Qwen3.5-35B-A3B architecture, see mudler/Qwen3.5-35B-A3B-APEX-GGUF .

What is APEX?

APEX is a quantization strategy for Mixture-of-Experts (MoE) models. It classifies tensors by role (routed expert, shared expert, attention) and applies a layer-wise precision gradient -- edge layers get higher precision, middle layers get more aggressive compression. I-variants use diverse imatrix calibration (chat, code, reasoning, tool-calling, agentic traces, Wikipedia).

See the APEX project for full details, technical report, and scripts.

Architecture
  • Model : Step-3.5-Flash (Step3p5)
  • Layers : 45 (3 dense + 42 MoE)
  • Experts : 288 routed + 1 shared (top-8 active per token)
  • Total Parameters : ~196B
  • Active Parameters : ~11B per token
  • Context : 256K tokens (MTP 4-token speculative head)
  • APEX Config : 5+5 symmetric edge gradient across 45 layers
Run with LocalAI
local-ai run mudler/[email protected]
Credits

APEX is brought to you by the LocalAI team. Developed through human-driven, AI-assisted research. Built on llama.cpp .

Runs of mudler Step-3.5-Flash-APEX-GGUF on huggingface.co

1.6K
Total runs
30
24-hour runs
10
3-day runs
-131
7-day runs
-300
30-day runs

More Information About Step-3.5-Flash-APEX-GGUF huggingface.co Model

More Step-3.5-Flash-APEX-GGUF license Visit here:

https://choosealicense.com/licenses/other

Step-3.5-Flash-APEX-GGUF huggingface.co

Step-3.5-Flash-APEX-GGUF huggingface.co is an AI model on huggingface.co that provides Step-3.5-Flash-APEX-GGUF's model effect (), which can be used instantly with this mudler Step-3.5-Flash-APEX-GGUF model. huggingface.co supports a free trial of the Step-3.5-Flash-APEX-GGUF model, and also provides paid use of the Step-3.5-Flash-APEX-GGUF. Support call Step-3.5-Flash-APEX-GGUF model through api, including Node.js, Python, http.

Step-3.5-Flash-APEX-GGUF huggingface.co Url

https://huggingface.co/mudler/Step-3.5-Flash-APEX-GGUF

mudler Step-3.5-Flash-APEX-GGUF online free

Step-3.5-Flash-APEX-GGUF huggingface.co is an online trial and call api platform, which integrates Step-3.5-Flash-APEX-GGUF's modeling effects, including api services, and provides a free online trial of Step-3.5-Flash-APEX-GGUF, you can try Step-3.5-Flash-APEX-GGUF online for free by clicking the link below.

mudler Step-3.5-Flash-APEX-GGUF online free url in huggingface.co:

https://huggingface.co/mudler/Step-3.5-Flash-APEX-GGUF

Step-3.5-Flash-APEX-GGUF install

Step-3.5-Flash-APEX-GGUF is an open source model from GitHub that offers a free installation service, and any user can find Step-3.5-Flash-APEX-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of Step-3.5-Flash-APEX-GGUF install, users can directly use Step-3.5-Flash-APEX-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Step-3.5-Flash-APEX-GGUF install url in huggingface.co:

https://huggingface.co/mudler/Step-3.5-Flash-APEX-GGUF

Url of Step-3.5-Flash-APEX-GGUF

Step-3.5-Flash-APEX-GGUF huggingface.co Url

Provider of Step-3.5-Flash-APEX-GGUF huggingface.co

mudler
ORGANIZATIONS

Other API from mudler

huggingface.co

Total runs: 14.2K
Run Growth: -1.0M
Growth Rate: -6843.62%
Updated:June 22 2026