Total runs:
1.1M
Run Growth:
55.8K
Growth Rate:
4.98%
Sponsored by
PostMcpAi
litert-community / SmolLM-135M-Instruct
Model's Last Updated: September 23 2025
text-generation
Introduction of SmolLM-135M-Instruct
Model Details of SmolLM-135M-Instruct
litert-community/SmolLM-135M-Instruct
This model provides a few variants of HuggingFaceTB/SmolLM-135M-Instruct that are ready for deployment on Android using the LiteRT (fka TFLite) stack and MediaPipe LLM Inference API .
Use the models
Colab
Disclaimer: The target deployment surface for the LiteRT models is Android/iOS/Web and the stack has been optimized for performance on these targets. Trying out the system in Colab is an easier way to familiarize yourself with the LiteRT stack, with the caveat that the performance (memory and latency) on Colab could be much worse than on a local device.
Android
- Download and install the apk .
- Follow the instructions in the app.
To build the demo app from source, please follow the instructions from the GitHub repository.
Performance
Android
Note that all benchmark stats are from a Samsung S24 Ultra with 1280 KV cache size with multiple prefill signatures enabled.
| Backend | Context length | Prefill (tokens/sec) | Decode (tokens/sec) | Time-to-first-token (sec) | Memory (RSS in MB) | Model size (MB) | |
|---|---|---|---|---|---|---|---|
| fp32 (baseline) | cpu |
1280 |
498.05 tk/s |
47.96 tk/s |
0.78 s |
931 MB |
527 MB |
| dynamic_int8 | cpu |
1280 |
1084.75 tk/s |
43.50 tk/s |
0.46 s |
579 MB |
159 MB |
- Model Size: measured by the size of the .tflite flatbuffer (serialization format for LiteRT models)
- Memory: indicator of peak RAM usage
- The inference on CPU is accelerated via the LiteRT XNNPACK delegate with 4 threads
- Benchmark is run with cache enabled and initialized. During the first run, the time to first token may differ.
- dynamic_int4: quantized model with int4 weights and float activations.
- dynamic_int8: quantized model with int8 weights and float activations.
Runs of litert-community SmolLM-135M-Instruct on huggingface.co
1.3K
Total runs
0
24-hour runs
-197
3-day runs
-486
7-day runs
-486
30-day runs
More Information About SmolLM-135M-Instruct huggingface.co Model
Url of SmolLM-135M-Instruct
SmolLM-135M-Instruct huggingface.co Url
Provider of SmolLM-135M-Instruct huggingface.co
Other API from litert-community
Updated:August 31 2026
Total runs:
339.1K
Run Growth:
-40.1K
Growth Rate:
-11.95%
Total runs:
71.7K
Run Growth:
-2.2K
Growth Rate:
-3.11%
Total runs:
61.3K
Run Growth:
-7.9K
Growth Rate:
-12.91%
Total runs:
43.2K
Run Growth:
10.2K
Growth Rate:
23.62%
Total runs:
23.2K
Run Growth:
-857
Growth Rate:
-3.69%
Total runs:
14.3K
Run Growth:
-678
Growth Rate:
-4.73%
Total runs:
13.7K
Run Growth:
1.2K
Growth Rate:
8.44%
Total runs:
13.0K
Run Growth:
2.9K
Growth Rate:
21.81%
Total runs:
7.1K
Run Growth:
-451
Growth Rate:
-6.38%
Total runs:
6.6K
Run Growth:
4.6K
Growth Rate:
70.75%
Total runs:
6.3K
Run Growth:
-1.5K
Growth Rate:
-24.14%
Total runs:
4.1K
Run Growth:
183
Growth Rate:
4.60%
Total runs:
3.7K
Run Growth:
3.3K
Growth Rate:
89.59%
Total runs:
3.6K
Run Growth:
681
Growth Rate:
19.14%
Total runs:
3.1K
Run Growth:
455
Growth Rate:
14.78%
Total runs:
2.9K
Run Growth:
2.2K
Growth Rate:
75.38%
Total runs:
2.5K
Run Growth:
2.3K
Growth Rate:
91.69%
Total runs:
2.4K
Run Growth:
936
Growth Rate:
39.11%
Total runs:
2.2K
Run Growth:
374
Growth Rate:
18.51%
Total runs:
2.2K
Run Growth:
1.5K
Growth Rate:
67.82%
Total runs:
2.1K
Run Growth:
2.1K
Growth Rate:
100.00%
Total runs:
2.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.1K
Run Growth:
-96
Growth Rate:
-4.64%
Total runs:
2.0K
Run Growth:
891
Growth Rate:
43.78%
Total runs:
2.0K
Run Growth:
117
Growth Rate:
5.86%
Total runs:
1.9K
Run Growth:
7
Growth Rate:
0.37%
Total runs:
1.9K
Run Growth:
-2.0K
Growth Rate:
-105.57%
Total runs:
1.8K
Run Growth:
594
Growth Rate:
34.32%
Total runs:
1.6K
Run Growth:
1.3K
Growth Rate:
80.33%
Total runs:
1.5K
Run Growth:
738
Growth Rate:
48.39%
Total runs:
1.3K
Run Growth:
984
Growth Rate:
73.21%
Total runs:
1.3K
Run Growth:
-107
Growth Rate:
-8.04%
Total runs:
1.3K
Run Growth:
295
Growth Rate:
23.41%
Total runs:
1.0K
Run Growth:
51
Growth Rate:
5.09%
Total runs:
968
Run Growth:
40
Growth Rate:
4.13%
Total runs:
932
Run Growth:
932
Growth Rate:
100.00%
Total runs:
894
Run Growth:
86
Growth Rate:
9.62%
Total runs:
752
Run Growth:
752
Growth Rate:
100.00%
Total runs:
735
Run Growth:
175
Growth Rate:
23.81%
Total runs:
716
Run Growth:
419
Growth Rate:
58.52%
Total runs:
645
Run Growth:
88
Growth Rate:
13.64%
Total runs:
628
Run Growth:
292
Growth Rate:
46.50%
Total runs:
613
Run Growth:
455
Growth Rate:
74.23%
Total runs:
571
Run Growth:
260
Growth Rate:
45.53%
Total runs:
560
Run Growth:
-656
Growth Rate:
-117.14%
Total runs:
486
Run Growth:
486
Growth Rate:
100.00%
Total runs:
485
Run Growth:
-47
Growth Rate:
-9.69%
Total runs:
464
Run Growth:
463
Growth Rate:
99.78%
Total runs:
453
Run Growth:
216
Growth Rate:
47.68%
Total runs:
432
Run Growth:
390
Growth Rate:
90.28%
Total runs:
426
Run Growth:
-50
Growth Rate:
-11.74%
Total runs:
425
Run Growth:
425
Growth Rate:
100.00%
Total runs:
418
Run Growth:
105
Growth Rate:
25.12%
Total runs:
413
Run Growth:
71
Growth Rate:
17.79%
Total runs:
406
Run Growth:
210
Growth Rate:
51.72%
Total runs:
392
Run Growth:
172
Growth Rate:
43.88%
Total runs:
369
Run Growth:
-380
Growth Rate:
-102.98%
Total runs:
366
Run Growth:
200
Growth Rate:
54.64%
Total runs:
364
Run Growth:
246
Growth Rate:
67.58%
Total runs:
357
Run Growth:
357
Growth Rate:
100.00%
Total runs:
340
Run Growth:
36
Growth Rate:
10.59%
Total runs:
334
Run Growth:
136
Growth Rate:
40.72%
Total runs:
314
Run Growth:
130
Growth Rate:
41.40%
Total runs:
301
Run Growth:
177
Growth Rate:
58.80%
Total runs:
292
Run Growth:
-241
Growth Rate:
-82.53%
Total runs:
274
Run Growth:
274
Growth Rate:
100.00%
Total runs:
271
Run Growth:
271
Growth Rate:
100.00%
Total runs:
260
Run Growth:
170
Growth Rate:
65.38%
Total runs:
251
Run Growth:
2
Growth Rate:
0.80%
Total runs:
248
Run Growth:
248
Growth Rate:
100.00%
Total runs:
246
Run Growth:
246
Growth Rate:
100.00%
Total runs:
239
Run Growth:
152
Growth Rate:
63.60%
Total runs:
234
Run Growth:
138
Growth Rate:
58.97%
Total runs:
231
Run Growth:
134
Growth Rate:
58.01%
Total runs:
226
Run Growth:
73
Growth Rate:
32.30%
Total runs:
220
Run Growth:
54
Growth Rate:
24.55%
Total runs:
218
Run Growth:
126
Growth Rate:
57.80%
Total runs:
216
Run Growth:
68
Growth Rate:
31.48%
Total runs:
213
Run Growth:
128
Growth Rate:
60.09%
Total runs:
202
Run Growth:
202
Growth Rate:
100.00%
Total runs:
202
Run Growth:
137
Growth Rate:
67.82%
Total runs:
194
Run Growth:
40
Growth Rate:
20.62%
Total runs:
189
Run Growth:
188
Growth Rate:
100.00%
Total runs:
175
Run Growth:
127
Growth Rate:
72.99%
Total runs:
172
Run Growth:
-12
Growth Rate:
-6.98%
Total runs:
172
Run Growth:
23
Growth Rate:
13.37%
Total runs:
171
Run Growth:
110
Growth Rate:
64.33%
Total runs:
170
Run Growth:
58
Growth Rate:
34.12%
Total runs:
169
Run Growth:
31
Growth Rate:
18.34%
Total runs:
165
Run Growth:
97
Growth Rate:
58.79%
Total runs:
165
Run Growth:
86
Growth Rate:
52.12%
Total runs:
164
Run Growth:
80
Growth Rate:
48.78%
Total runs:
158
Run Growth:
158
Growth Rate:
100.00%
Total runs:
154
Run Growth:
83
Growth Rate:
58.45%
Total runs:
152
Run Growth:
-784
Growth Rate:
-515.79%
Total runs:
152
Run Growth:
29
Growth Rate:
19.08%
Total runs:
144
Run Growth:
81
Growth Rate:
56.25%