qwen3_5_0_8b_xnnpack_8da4w_e8.pte
(651.1 MB — down from 1413 MB without embedding
quantization; the 248320x1024 fp32 embedding was ~1 GB of the first export)
Generation gate 3/3 via
llm_params/gen_static.py
(token-by-token prefill + greedy decode):
prompt
output
decode tok/s
capital of France?
Paris (correct; adds a wrong "second-largest city in Europe" claim — model-level, same as fp32-embedding export)
21.0
日本の首都は?(日本語)
「日本の首都は
東京
です。」
21.4
haiku about autumn leaves
3-line poem
21.3
Decode ~21 tok/s matches the fp32-embedding export (20.6) — the size cut is free.
Prefill tok/s is sequential-prefill reference only (static export).
Chat template: ChatML, bos 248045, eos [248046, 248044].
iPhone 17 Pro (ETBench, XNNPACK CPU, default threads): decode
10.5 tok/s
, ttft 0.58 s,
load 0.7 s — same speed as the 1413 MB fp32-embedding export (9.2-11.1 tok/s), at 46% of its size.
(Thermal note: a hot device throttles to ~7 tok/s; numbers above are from a cool run.)
Runs of mlboydaisuke Qwen3.5-0.8B-ExecuTorch on huggingface.co
77
Total runs
-2
24-hour runs
-6
3-day runs
-7
7-day runs
-234
30-day runs
More Information About Qwen3.5-0.8B-ExecuTorch huggingface.co Model
Qwen3.5-0.8B-ExecuTorch huggingface.co is an AI model on huggingface.co that provides Qwen3.5-0.8B-ExecuTorch's model effect (), which can be used instantly with this mlboydaisuke Qwen3.5-0.8B-ExecuTorch model. huggingface.co supports a free trial of the Qwen3.5-0.8B-ExecuTorch model, and also provides paid use of the Qwen3.5-0.8B-ExecuTorch. Support call Qwen3.5-0.8B-ExecuTorch model through api, including Node.js, Python, http.
Qwen3.5-0.8B-ExecuTorch huggingface.co is an online trial and call api platform, which integrates Qwen3.5-0.8B-ExecuTorch's modeling effects, including api services, and provides a free online trial of Qwen3.5-0.8B-ExecuTorch, you can try Qwen3.5-0.8B-ExecuTorch online for free by clicking the link below.
mlboydaisuke Qwen3.5-0.8B-ExecuTorch online free url in huggingface.co:
Qwen3.5-0.8B-ExecuTorch is an open source model from GitHub that offers a free installation service, and any user can find Qwen3.5-0.8B-ExecuTorch on GitHub to install. At the same time, huggingface.co provides the effect of Qwen3.5-0.8B-ExecuTorch install, users can directly use Qwen3.5-0.8B-ExecuTorch installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
Qwen3.5-0.8B-ExecuTorch install url in huggingface.co: