Total runs:
357.4K
Run Growth:
-685.0K
Growth Rate:
-197.83%
Sponsored by
APIMart
tiiuae / Falcon-H1-Tiny-90M-Instruct-GGUF
Model's Last Updated: January 16 2026
Introduction of Falcon-H1-Tiny-90M-Instruct-GGUF
Model Details of Falcon-H1-Tiny-90M-Instruct-GGUF
Table of Contents
TL;DR
Model Details
Model Description
- Developed by: https://www.tii.ae
- Model type: Causal decoder-only
- Architecture: Hybrid Transformers + Mamba architecture
- Language(s) (NLP): English
- Number of Parameters: 90M
- License: Falcon-LLM License
Training details
For more details about the training protocol of this model, please refer to the Falcon-H1-Tiny technical blogpost .
Usage
Currently to use this model you can either rely on Hugging Face
transformers
,
vLLM
,
sglang
,
llama.cpp
,
ollama
or
mlx
library.
Inference
🤗 transformers
Refer to the snippet below to run H1 models using 🤗 transformers:
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "tiiuae/Falcon-H1-Tiny-90M-Instruct-pre-DPO"
model = AutoModelForCausalLM.from_pretrained(
model_id,
torch_dtype=torch.bfloat16,
device_map="auto"
)
# Perform text generation
or
transformers serve tiiuae/Falcon-H1-Tiny-90M-Instruct-pre-DPO
llama.cpp
You can find all GGUF files compatible with
llama.cpp
under
our official collection
- an example setup could be:
brew install llama.cpp
pip install huggingface_hub
hf download tiiuae/Falcon-H1-Tiny-90M-Instruct-pre-DPO Falcon-H1-Tiny-90M-Instruct-pre-DPO-Q8_0.gguf --local-dir ./
llama-cli ./ Falcon-H1-Tiny-90M-Instruct-pre-DPO-Q8_0.gguf -cnv
ollama
ollama run hf.co/tiiuae/Falcon-H1-Tiny-90M-Instruct-GGUF:Q8_0
Apple
mlx
mlx_lm.chat --model tiiuae/Tiny-H1-SF
vLLM
For vLLM, simply start a server by executing the command below:
# pip install vllm>=0.9.0
vllm serve tiiuae/Falcon-H1-Tiny-90M-Instruct-pre-DPO --tensor-parallel-size 2 --data-parallel-size 1
sglang
python -m sglang.launch_server \
--model ttiiuae/Falcon-H1-Tiny-90M-Instruct-pre-DPO \
--tensor-parallel-size 1
Evaluation
For detailed evaluation of Tiny-H1 series, please refer to our technical blogpost
Useful links
- View our release blogpost .
- Feel free to join our discord server if you have any questions or to interact with our researchers and developers.
Citation
If the Falcon-H1-Tiny family of models were helpful to your work, feel free to give us a cite.
@misc{falcon_h1_tiny,
title={Falcon-H1-Tiny: A series of extremely small, yet powerful language models redefining capabilities at small scale},
author={Falcon-LLM Team},
year={2026},
}
Runs of tiiuae Falcon-H1-Tiny-90M-Instruct-GGUF on huggingface.co
3.7K
Total runs
0
24-hour runs
80
3-day runs
-1.2K
7-day runs
-967
30-day runs
More Information About Falcon-H1-Tiny-90M-Instruct-GGUF huggingface.co Model
Url of Falcon-H1-Tiny-90M-Instruct-GGUF
Falcon-H1-Tiny-90M-Instruct-GGUF huggingface.co Url
Provider of Falcon-H1-Tiny-90M-Instruct-GGUF huggingface.co
Other API from tiiuae
Updated:October 12 2024
Total runs:
105.9K
Run Growth:
11.1K
Growth Rate:
10.49%
Total runs:
60.1K
Run Growth:
32.3K
Growth Rate:
53.81%
Total runs:
44.6K
Run Growth:
-125.2K
Growth Rate:
-280.36%
Total runs:
32.1K
Run Growth:
-679
Growth Rate:
-2.13%
Total runs:
21.2K
Run Growth:
-2.7K
Growth Rate:
-12.84%
Total runs:
16.6K
Run Growth:
-508
Growth Rate:
-3.06%
Total runs:
15.8K
Run Growth:
-1.9K
Growth Rate:
-12.24%
Total runs:
15.3K
Run Growth:
1.1K
Growth Rate:
6.85%
Total runs:
14.7K
Run Growth:
-9.1K
Growth Rate:
-61.46%
Total runs:
13.3K
Run Growth:
-3.5K
Growth Rate:
-26.36%
Total runs:
11.7K
Run Growth:
-554
Growth Rate:
-4.74%
Total runs:
9.9K
Run Growth:
6.0K
Growth Rate:
60.71%
Total runs:
8.4K
Run Growth:
1.6K
Growth Rate:
18.87%
Total runs:
8.0K
Run Growth:
341
Growth Rate:
4.24%
Total runs:
7.5K
Run Growth:
1.5K
Growth Rate:
20.17%
Total runs:
6.5K
Run Growth:
-819
Growth Rate:
-12.56%
Total runs:
5.0K
Run Growth:
1.9K
Growth Rate:
37.53%
Total runs:
4.6K
Run Growth:
2.1K
Growth Rate:
45.56%
Total runs:
4.0K
Run Growth:
1.4K
Growth Rate:
34.67%
Total runs:
4.0K
Run Growth:
2.0K
Growth Rate:
51.65%
Total runs:
3.2K
Run Growth:
31
Growth Rate:
0.96%
Total runs:
3.1K
Run Growth:
1.7K
Growth Rate:
56.84%
Total runs:
2.6K
Run Growth:
1.7K
Growth Rate:
66.82%
Total runs:
2.3K
Run Growth:
1.8K
Growth Rate:
80.17%
Total runs:
1.7K
Run Growth:
132
Growth Rate:
7.99%
Total runs:
1.6K
Run Growth:
636
Growth Rate:
40.80%
Total runs:
1.5K
Run Growth:
-135
Growth Rate:
-9.22%
Total runs:
1.3K
Run Growth:
851
Growth Rate:
65.61%
Total runs:
1.3K
Run Growth:
18
Growth Rate:
1.40%
Total runs:
1.3K
Run Growth:
378
Growth Rate:
29.42%
Total runs:
1.3K
Run Growth:
952
Growth Rate:
76.16%
Total runs:
988
Run Growth:
0
Growth Rate:
0.00%
Total runs:
986
Run Growth:
36
Growth Rate:
3.65%
Total runs:
914
Run Growth:
-396
Growth Rate:
-43.33%
Total runs:
851
Run Growth:
106
Growth Rate:
12.46%
Total runs:
769
Run Growth:
-363
Growth Rate:
-47.20%
Total runs:
683
Run Growth:
-200
Growth Rate:
-29.28%
Total runs:
532
Run Growth:
18
Growth Rate:
3.38%
Total runs:
525
Run Growth:
522
Growth Rate:
99.43%
Total runs:
500
Run Growth:
-33
Growth Rate:
-6.60%
Total runs:
482
Run Growth:
-23
Growth Rate:
-4.77%
Total runs:
473
Run Growth:
81
Growth Rate:
17.12%
Total runs:
446
Run Growth:
20
Growth Rate:
4.48%
Total runs:
400
Run Growth:
109
Growth Rate:
27.25%
Total runs:
385
Run Growth:
131
Growth Rate:
34.03%
Total runs:
383
Run Growth:
-51
Growth Rate:
-13.32%
Total runs:
327
Run Growth:
20
Growth Rate:
6.12%
Total runs:
324
Run Growth:
-231
Growth Rate:
-71.30%
Total runs:
317
Run Growth:
4
Growth Rate:
1.26%
Total runs:
311
Run Growth:
17
Growth Rate:
5.47%
Total runs:
306
Run Growth:
274
Growth Rate:
89.54%
Total runs:
293
Run Growth:
45
Growth Rate:
15.36%
Total runs:
273
Run Growth:
246
Growth Rate:
90.11%
Total runs:
223
Run Growth:
-212
Growth Rate:
-95.07%
Total runs:
201
Run Growth:
82
Growth Rate:
40.80%
Total runs:
200
Run Growth:
-433
Growth Rate:
-216.50%
Total runs:
196
Run Growth:
86
Growth Rate:
43.88%
Total runs:
193
Run Growth:
-24
Growth Rate:
-12.44%
Total runs:
181
Run Growth:
-80
Growth Rate:
-44.20%
Total runs:
176
Run Growth:
74
Growth Rate:
42.05%
Total runs:
175
Run Growth:
47
Growth Rate:
26.86%
Total runs:
167
Run Growth:
7
Growth Rate:
4.19%
Total runs:
166
Run Growth:
12
Growth Rate:
7.23%
Total runs:
154
Run Growth:
64
Growth Rate:
41.56%
Total runs:
147
Run Growth:
60
Growth Rate:
40.82%
Total runs:
136
Run Growth:
15
Growth Rate:
11.03%
Total runs:
116
Run Growth:
22
Growth Rate:
18.97%
Total runs:
107
Run Growth:
-231
Growth Rate:
-215.89%
Total runs:
105
Run Growth:
19
Growth Rate:
18.10%
Total runs:
97
Run Growth:
97
Growth Rate:
100.00%
Total runs:
77
Run Growth:
24
Growth Rate:
31.17%
Total runs:
72
Run Growth:
72
Growth Rate:
100.00%
Total runs:
62
Run Growth:
7
Growth Rate:
11.29%
Total runs:
60
Run Growth:
-4
Growth Rate:
-6.67%
Total runs:
59
Run Growth:
-149
Growth Rate:
-252.54%
Total runs:
57
Run Growth:
-68
Growth Rate:
-174.36%
Total runs:
55
Run Growth:
21
Growth Rate:
38.18%
Total runs:
52
Run Growth:
0
Growth Rate:
0.00%
Total runs:
50
Run Growth:
1
Growth Rate:
2.00%
Total runs:
42
Run Growth:
16
Growth Rate:
38.10%
Total runs:
40
Run Growth:
15
Growth Rate:
37.50%
Total runs:
40
Run Growth:
17
Growth Rate:
42.50%
Total runs:
39
Run Growth:
9
Growth Rate:
23.08%