Total runs:
186.7K
Run Growth:
-55.5K
Growth Rate:
-29.75%
Sponsored by
ThumbnailCreator.com
ybelkada / bloom-1b7-8bit
Model's Last Updated: April 17 2023
text-generation
Introduction of bloom-1b7-8bit
Model Details of bloom-1b7-8bit
BLOOM LM - 8bit
BigScience Large Open-science Open-access Multilingual Language Model - 8bit
Model Card
Version 1.0 / 26.May.2022
Related paper: https://arxiv.org/abs/2208.07339
TL;DR
This repository contains 8bit weights of
bloom-1b7
model. You can load this model using
transformers==4.28.0
and
bitsandbytes>0.37.2
out of the box !
# pip install accelerate bitsandbytes
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("ybelkada/bloom-1b7-8bit")
How to push 8bit weights?
First, make sure you are using
transformers
&
bitsandbytes
versions stated above. Then load your 8bit model as usual using
load_in_8bit=True
!
# pip install accelerate bitsandbytes
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("bigscience/bloom-1b7", device_map="auto", load_in_8bit=True)
Then just call
push_to_hub
method or
save_pretrained
method if you want to save your 8bit model locally
model.push_to_hub("{your_username}/bloom-1b7-8bit")
That's it!
What is inside the model's
state_dict
?
Inside the state dict of the model (
pytorch_model.bin
file) you have
-
the quantized
int8weights -
the quantization statistics in
float16
Runs of ybelkada bloom-1b7-8bit on huggingface.co
193
Total runs
-7
24-hour runs
-22
3-day runs
-41
7-day runs
-168
30-day runs
More Information About bloom-1b7-8bit huggingface.co Model
Url of bloom-1b7-8bit
bloom-1b7-8bit huggingface.co Url
Provider of bloom-1b7-8bit huggingface.co
Other API from ybelkada
Updated:December 09 2024
Total runs:
7.9K
Run Growth:
4.3K
Growth Rate:
54.63%
Total runs:
1.7K
Run Growth:
968
Growth Rate:
56.34%
Total runs:
1.6K
Run Growth:
-1.5K
Growth Rate:
-93.38%
Total runs:
417
Run Growth:
134
Growth Rate:
32.13%
Total runs:
407
Run Growth:
-934
Growth Rate:
-229.48%
Total runs:
386
Run Growth:
120
Growth Rate:
31.09%
Total runs:
230
Run Growth:
147
Growth Rate:
65.63%
Total runs:
204
Run Growth:
-10
Growth Rate:
-4.90%
Total runs:
189
Run Growth:
42
Growth Rate:
22.22%
Total runs:
174
Run Growth:
44
Growth Rate:
25.29%
Total runs:
145
Run Growth:
0
Growth Rate:
0.00%
Total runs:
128
Run Growth:
52
Growth Rate:
40.63%
Total runs:
106
Run Growth:
53
Growth Rate:
50.00%
Total runs:
98
Run Growth:
63
Growth Rate:
64.29%
Total runs:
93
Run Growth:
-162
Growth Rate:
-174.19%
Total runs:
45
Run Growth:
39
Growth Rate:
86.67%
Total runs:
38
Run Growth:
-4
Growth Rate:
-10.53%
Total runs:
38
Run Growth:
15
Growth Rate:
39.47%
Total runs:
30
Run Growth:
15
Growth Rate:
50.00%
Total runs:
26
Run Growth:
-3
Growth Rate:
-11.54%
Total runs:
24
Run Growth:
5
Growth Rate:
20.83%
Total runs:
24
Run Growth:
3
Growth Rate:
12.50%
Total runs:
24
Run Growth:
9
Growth Rate:
37.50%
Total runs:
22
Run Growth:
-2
Growth Rate:
-9.09%
Total runs:
22
Run Growth:
9
Growth Rate:
40.91%
Total runs:
22
Run Growth:
11
Growth Rate:
50.00%
Total runs:
21
Run Growth:
6
Growth Rate:
28.57%
Total runs:
19
Run Growth:
7
Growth Rate:
36.84%
Total runs:
18
Run Growth:
5
Growth Rate:
27.78%
Total runs:
16
Run Growth:
-25
Growth Rate:
-156.25%
Total runs:
15
Run Growth:
-7
Growth Rate:
-46.67%
Total runs:
14
Run Growth:
1
Growth Rate:
7.14%
Total runs:
14
Run Growth:
-1
Growth Rate:
-7.14%
Total runs:
14
Run Growth:
-9
Growth Rate:
-64.29%
Total runs:
14
Run Growth:
5
Growth Rate:
35.71%
Total runs:
13
Run Growth:
-3
Growth Rate:
-23.08%
Total runs:
13
Run Growth:
-6
Growth Rate:
-46.15%
Total runs:
13
Run Growth:
-1
Growth Rate:
-7.69%
Total runs:
12
Run Growth:
-2
Growth Rate:
-16.67%
Total runs:
12
Run Growth:
3
Growth Rate:
25.00%
Total runs:
12
Run Growth:
0
Growth Rate:
0.00%
Total runs:
12
Run Growth:
0
Growth Rate:
0.00%
Total runs:
12
Run Growth:
-10
Growth Rate:
-83.33%
Total runs:
11
Run Growth:
0
Growth Rate:
0.00%
Total runs:
10
Run Growth:
-6
Growth Rate:
-60.00%
Total runs:
10
Run Growth:
-3
Growth Rate:
-30.00%
Total runs:
9
Run Growth:
-4
Growth Rate:
-44.44%
Total runs:
8
Run Growth:
2
Growth Rate:
25.00%
Total runs:
8
Run Growth:
-1
Growth Rate:
-12.50%
Total runs:
7
Run Growth:
0
Growth Rate:
0.00%
Total runs:
7
Run Growth:
0
Growth Rate:
0.00%
Total runs:
7
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
-7
Growth Rate:
-175.00%
Total runs:
4
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
-1
Growth Rate:
-33.33%
Total runs:
2
Run Growth:
-4
Growth Rate:
-200.00%
Total runs:
1
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%