Total runs:
395.1K
Run Growth:
-182.1K
Growth Rate:
-45.94%
Sponsored by
APIMart
tiiuae / Falcon3-3B-Instruct-1.58bit
Model's Last Updated: January 13 2025
text-generation
Introduction of Falcon3-3B-Instruct-1.58bit
Model Details of Falcon3-3B-Instruct-1.58bit
Table of Contents
TL;DR
Model Details
Model Description
- Developed by: https://www.tii.ae
- Model type: Causal decoder-only - instruct / chat version
- Architecture: Pure-transformer - 1.58bit version
- Language(s) (NLP): Mainly English
- License: TII Falcon License 2.0
Training details
The model has been trained following the training strategies from the recent 1-bit LLM HF blogpost and 1-bit LLM paper . For more details about the training protocol of this model, please refer to the Falcon-3 technical report, section Compression .
Usage
Currently to use this model you can either rely on Hugging Face transformers library or BitNet library. You can also play with the model using the falcon-1.58bit playground (only for the 7B instruct version).
🤗 transformers
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "tiiuae/Falcon3-3B-Instruct-1.58bit"
model = AutoModelForCausalLM.from_pretrained(
model_id,
torch_dtype=torch.bfloat16,
).to("cuda")
# Perform text generation
BitNet
git clone https://github.com/microsoft/BitNet && cd BitNet
pip install -r requirements.txt
python setup_env.py --hf-repo tiiuae/Falcon3-3B-Instruct-1.58bit -q i2_s
python run_inference.py -m models/Falcon3-3B-1.58bit/ggml-model-i2_s.gguf -p "You are a helpful assistant." -cnv
Evaluation
Coming soon ..
Useful links
- View our release blogpost .
- Feel free to join our discord server if you have any questions or to interact with our researchers and developers.
Citation
If the Falcon3 family of models were helpful to your work, feel free to give us a cite.
@misc{Falcon3,
title = {The Falcon 3 Family of Open Models},
author = {Falcon-LLM Team},
month = {December},
year = {2024}
}
Runs of tiiuae Falcon3-3B-Instruct-1.58bit on huggingface.co
193
Total runs
0
24-hour runs
-5
3-day runs
-36
7-day runs
-24
30-day runs
More Information About Falcon3-3B-Instruct-1.58bit huggingface.co Model
Url of Falcon3-3B-Instruct-1.58bit
Falcon3-3B-Instruct-1.58bit huggingface.co Url
Provider of Falcon3-3B-Instruct-1.58bit huggingface.co
Other API from tiiuae
Updated:October 12 2024
Total runs:
105.9K
Run Growth:
11.1K
Growth Rate:
10.49%
Total runs:
60.1K
Run Growth:
32.3K
Growth Rate:
53.81%
Total runs:
44.6K
Run Growth:
-125.2K
Growth Rate:
-280.36%
Total runs:
32.3K
Run Growth:
1.1K
Growth Rate:
3.27%
Total runs:
20.2K
Run Growth:
-973
Growth Rate:
-4.82%
Total runs:
16.6K
Run Growth:
-508
Growth Rate:
-3.06%
Total runs:
15.8K
Run Growth:
-1.9K
Growth Rate:
-12.24%
Total runs:
15.3K
Run Growth:
1.1K
Growth Rate:
6.85%
Total runs:
14.7K
Run Growth:
-9.1K
Growth Rate:
-61.46%
Total runs:
13.3K
Run Growth:
-3.5K
Growth Rate:
-26.36%
Total runs:
11.8K
Run Growth:
5.8K
Growth Rate:
48.78%
Total runs:
10.6K
Run Growth:
-262
Growth Rate:
-2.49%
Total runs:
9.1K
Run Growth:
70
Growth Rate:
0.77%
Total runs:
8.4K
Run Growth:
1.6K
Growth Rate:
18.87%
Total runs:
8.0K
Run Growth:
341
Growth Rate:
4.24%
Total runs:
7.4K
Run Growth:
-569
Growth Rate:
-7.67%
Total runs:
6.5K
Run Growth:
-819
Growth Rate:
-12.56%
Total runs:
5.0K
Run Growth:
1.9K
Growth Rate:
37.53%
Total runs:
4.6K
Run Growth:
2.1K
Growth Rate:
45.56%
Total runs:
3.9K
Run Growth:
-300
Growth Rate:
-7.68%
Total runs:
3.7K
Run Growth:
-967
Growth Rate:
-25.92%
Total runs:
3.2K
Run Growth:
31
Growth Rate:
0.96%
Total runs:
3.1K
Run Growth:
100
Growth Rate:
3.37%
Total runs:
3.1K
Run Growth:
1.7K
Growth Rate:
56.84%
Total runs:
2.6K
Run Growth:
109
Growth Rate:
4.26%
Total runs:
2.3K
Run Growth:
1.8K
Growth Rate:
80.17%
Total runs:
1.7K
Run Growth:
88
Growth Rate:
5.21%
Total runs:
1.6K
Run Growth:
636
Growth Rate:
40.80%
Total runs:
1.5K
Run Growth:
-397
Growth Rate:
-26.40%
Total runs:
1.3K
Run Growth:
18
Growth Rate:
1.40%
Total runs:
1.3K
Run Growth:
378
Growth Rate:
29.42%
Total runs:
1.3K
Run Growth:
952
Growth Rate:
76.16%
Total runs:
988
Run Growth:
0
Growth Rate:
0.00%
Total runs:
986
Run Growth:
36
Growth Rate:
3.65%
Total runs:
914
Run Growth:
-396
Growth Rate:
-43.33%
Total runs:
851
Run Growth:
106
Growth Rate:
12.46%
Total runs:
801
Run Growth:
273
Growth Rate:
34.08%
Total runs:
769
Run Growth:
-363
Growth Rate:
-47.20%
Total runs:
683
Run Growth:
-200
Growth Rate:
-29.28%
Total runs:
636
Run Growth:
-761
Growth Rate:
-119.65%
Total runs:
525
Run Growth:
522
Growth Rate:
99.43%
Total runs:
500
Run Growth:
-33
Growth Rate:
-6.60%
Total runs:
482
Run Growth:
-23
Growth Rate:
-4.77%
Total runs:
473
Run Growth:
81
Growth Rate:
17.12%
Total runs:
446
Run Growth:
20
Growth Rate:
4.48%
Total runs:
400
Run Growth:
109
Growth Rate:
27.25%
Total runs:
385
Run Growth:
131
Growth Rate:
34.03%
Total runs:
383
Run Growth:
-51
Growth Rate:
-13.32%
Total runs:
327
Run Growth:
20
Growth Rate:
6.12%
Total runs:
324
Run Growth:
-231
Growth Rate:
-71.30%
Total runs:
317
Run Growth:
4
Growth Rate:
1.26%
Total runs:
311
Run Growth:
17
Growth Rate:
5.47%
Total runs:
306
Run Growth:
274
Growth Rate:
89.54%
Total runs:
273
Run Growth:
246
Growth Rate:
90.11%
Total runs:
223
Run Growth:
-212
Growth Rate:
-95.07%
Total runs:
222
Run Growth:
76
Growth Rate:
34.23%
Total runs:
201
Run Growth:
82
Growth Rate:
40.80%
Total runs:
200
Run Growth:
-433
Growth Rate:
-216.50%
Total runs:
181
Run Growth:
-80
Growth Rate:
-44.20%
Total runs:
176
Run Growth:
74
Growth Rate:
42.05%
Total runs:
175
Run Growth:
47
Growth Rate:
26.86%
Total runs:
167
Run Growth:
7
Growth Rate:
4.19%
Total runs:
166
Run Growth:
12
Growth Rate:
7.23%
Total runs:
154
Run Growth:
64
Growth Rate:
41.56%
Total runs:
147
Run Growth:
60
Growth Rate:
40.82%
Total runs:
136
Run Growth:
15
Growth Rate:
11.03%
Total runs:
115
Run Growth:
25
Growth Rate:
21.74%
Total runs:
107
Run Growth:
-231
Growth Rate:
-215.89%
Total runs:
105
Run Growth:
19
Growth Rate:
18.10%
Total runs:
97
Run Growth:
97
Growth Rate:
100.00%
Total runs:
77
Run Growth:
24
Growth Rate:
31.17%
Total runs:
72
Run Growth:
72
Growth Rate:
100.00%
Total runs:
62
Run Growth:
7
Growth Rate:
11.29%
Total runs:
60
Run Growth:
-4
Growth Rate:
-6.67%
Total runs:
60
Run Growth:
-23
Growth Rate:
-38.33%
Total runs:
59
Run Growth:
-149
Growth Rate:
-252.54%
Total runs:
55
Run Growth:
21
Growth Rate:
38.18%
Total runs:
52
Run Growth:
0
Growth Rate:
0.00%
Total runs:
50
Run Growth:
1
Growth Rate:
2.00%
Total runs:
42
Run Growth:
16
Growth Rate:
38.10%
Total runs:
40
Run Growth:
15
Growth Rate:
37.50%
Total runs:
40
Run Growth:
17
Growth Rate:
42.50%
Total runs:
39
Run Growth:
9
Growth Rate:
23.08%