mlboydaisuke / Qwen3.5-0.8B-ExecuTorch

huggingface.co
Total runs: 77
24-hour runs: -2
7-day runs: -7
30-day runs: -234
Model's Last Updated: September 04 2026
text-generation

Introduction of Qwen3.5-0.8B-ExecuTorch

Model Details of Qwen3.5-0.8B-ExecuTorch

Qwen3.5-0.8B — ExecuTorch XNNPACK 8da4w + 8-bit embedding

qwen3_5_0_8b_xnnpack_8da4w_e8.pte (651.1 MB — down from 1413 MB without embedding quantization; the 248320x1024 fp32 embedding was ~1 GB of the first export)

  • Source : Qwen/Qwen3.5-0.8B
  • License : Apache-2.0
  • Quantization : 8da4w linear + 8-bit embedding ( embedding_quantize: "8,0" )
  • Export : executorch 1.4.0 export_llm , static shape (seq_len=1), max_seq_length 2048, XNNPACK extended_ops
  • Config : llm_params/qwen3_5_0_8b_xnnpack_8da4w_e8.yaml
Verification (Mac arm64, 2026-08-13)

Generation gate 3/3 via llm_params/gen_static.py (token-by-token prefill + greedy decode):

prompt output decode tok/s
capital of France? Paris (correct; adds a wrong "second-largest city in Europe" claim — model-level, same as fp32-embedding export) 21.0
日本の首都は?(日本語) 「日本の首都は 東京 です。」 21.4
haiku about autumn leaves 3-line poem 21.3

Decode ~21 tok/s matches the fp32-embedding export (20.6) — the size cut is free. Prefill tok/s is sequential-prefill reference only (static export). Chat template: ChatML, bos 248045, eos [248046, 248044].

iPhone 17 Pro (ETBench, XNNPACK CPU, default threads): decode 10.5 tok/s , ttft 0.58 s, load 0.7 s — same speed as the 1413 MB fp32-embedding export (9.2-11.1 tok/s), at 46% of its size. (Thermal note: a hot device throttles to ~7 tok/s; numbers above are from a cool run.)

Runs of mlboydaisuke Qwen3.5-0.8B-ExecuTorch on huggingface.co

77
Total runs
-2
24-hour runs
-6
3-day runs
-7
7-day runs
-234
30-day runs

More Information About Qwen3.5-0.8B-ExecuTorch huggingface.co Model

More Qwen3.5-0.8B-ExecuTorch license Visit here:

https://choosealicense.com/licenses/apache-2.0

Qwen3.5-0.8B-ExecuTorch huggingface.co

Qwen3.5-0.8B-ExecuTorch huggingface.co is an AI model on huggingface.co that provides Qwen3.5-0.8B-ExecuTorch's model effect (), which can be used instantly with this mlboydaisuke Qwen3.5-0.8B-ExecuTorch model. huggingface.co supports a free trial of the Qwen3.5-0.8B-ExecuTorch model, and also provides paid use of the Qwen3.5-0.8B-ExecuTorch. Support call Qwen3.5-0.8B-ExecuTorch model through api, including Node.js, Python, http.

Qwen3.5-0.8B-ExecuTorch huggingface.co Url

https://huggingface.co/mlboydaisuke/Qwen3.5-0.8B-ExecuTorch

mlboydaisuke Qwen3.5-0.8B-ExecuTorch online free

Qwen3.5-0.8B-ExecuTorch huggingface.co is an online trial and call api platform, which integrates Qwen3.5-0.8B-ExecuTorch's modeling effects, including api services, and provides a free online trial of Qwen3.5-0.8B-ExecuTorch, you can try Qwen3.5-0.8B-ExecuTorch online for free by clicking the link below.

mlboydaisuke Qwen3.5-0.8B-ExecuTorch online free url in huggingface.co:

https://huggingface.co/mlboydaisuke/Qwen3.5-0.8B-ExecuTorch

Qwen3.5-0.8B-ExecuTorch install

Qwen3.5-0.8B-ExecuTorch is an open source model from GitHub that offers a free installation service, and any user can find Qwen3.5-0.8B-ExecuTorch on GitHub to install. At the same time, huggingface.co provides the effect of Qwen3.5-0.8B-ExecuTorch install, users can directly use Qwen3.5-0.8B-ExecuTorch installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Qwen3.5-0.8B-ExecuTorch install url in huggingface.co:

https://huggingface.co/mlboydaisuke/Qwen3.5-0.8B-ExecuTorch

Url of Qwen3.5-0.8B-ExecuTorch

Qwen3.5-0.8B-ExecuTorch huggingface.co Url

Provider of Qwen3.5-0.8B-ExecuTorch huggingface.co

mlboydaisuke
ORGANIZATIONS

Other API from mlboydaisuke