Total runs:
78.5K
Run Growth:
-49.5K
Growth Rate:
-62.99%
Sponsored by
APIMart
philschmid / flan-ul2-20b-fp16
Model's Last Updated: March 05 2023
text-generation
Introduction of flan-ul2-20b-fp16
Model Details of flan-ul2-20b-fp16
FORK of google/flan-ul2
This is a fork of google/flan-ul2 20B implementing a custom
handler.pyfor deploying the model to inference-endpoints on a 4x NVIDIA T4.
You can deploy the flan-ul2 with a 1-click .
Note: Creation of the endpoint can take 2 hours due super long building process, be patient. We are working on improving this!
TL;DR
Flan-UL2 is an encoder decoder model based on the
T5
architecture. It uses the same configuration as the
UL2 model
released earlier last year. It was fine tuned using the "Flan" prompt tuning
and dataset collection.
According ot the original blog here are the notable improvements:
- The original UL2 model was only trained with receptive field of 512, which made it non-ideal for N-shot prompting where N is large.
- The Flan-UL2 checkpoint uses a receptive field of 2048 which makes it more usable for few-shot in-context learning.
- The original UL2 model also had mode switch tokens that was rather mandatory to get good performance. However, they were a little cumbersome as this requires often some changes during inference or finetuning. In this update/change, we continue training UL2 20B for an additional 100k steps (with small batch) to forget “mode tokens” before applying Flan instruction tuning. This Flan-UL2 checkpoint does not require mode tokens anymore.
Important : For more details, please see sections 5.2.1 and 5.2.2 of the paper .
Contribution
This model was originally contributed by Yi Tay , and added to the Hugging Face ecosystem by Younes Belkada & Arthur Zucker .
Citation
If you want to cite this work, please consider citing the
blogpost
announcing the release of
Flan-UL2
.
Runs of philschmid flan-ul2-20b-fp16 on huggingface.co
92
Total runs
0
24-hour runs
8
3-day runs
-2
7-day runs
52
30-day runs
More Information About flan-ul2-20b-fp16 huggingface.co Model
Url of flan-ul2-20b-fp16
flan-ul2-20b-fp16 huggingface.co Url
Provider of flan-ul2-20b-fp16 huggingface.co
Other API from philschmid
Updated:December 24 2022
Total runs:
8.5K
Run Growth:
-2.7K
Growth Rate:
-31.06%
Total runs:
4.2K
Run Growth:
284
Growth Rate:
6.73%
Total runs:
4.0K
Run Growth:
1.6K
Growth Rate:
43.63%
Total runs:
2.4K
Run Growth:
-1.3K
Growth Rate:
-54.03%
Total runs:
2.1K
Run Growth:
-1.3K
Growth Rate:
-61.67%
Total runs:
1.7K
Run Growth:
-157
Growth Rate:
-9.00%
Total runs:
1.6K
Run Growth:
114
Growth Rate:
7.24%
Total runs:
979
Run Growth:
-1.1K
Growth Rate:
-114.20%
Total runs:
844
Run Growth:
-28
Growth Rate:
-3.32%
Total runs:
702
Run Growth:
464
Growth Rate:
66.10%
Total runs:
244
Run Growth:
154
Growth Rate:
63.11%
Total runs:
172
Run Growth:
77
Growth Rate:
44.77%
Total runs:
150
Run Growth:
101
Growth Rate:
67.33%
Total runs:
138
Run Growth:
103
Growth Rate:
74.64%
Total runs:
131
Run Growth:
34
Growth Rate:
25.95%
Total runs:
114
Run Growth:
-218
Growth Rate:
-191.23%
Total runs:
106
Run Growth:
64
Growth Rate:
60.38%
Total runs:
101
Run Growth:
15
Growth Rate:
14.85%
Total runs:
95
Run Growth:
0
Growth Rate:
0.00%
Total runs:
77
Run Growth:
50
Growth Rate:
64.94%
Total runs:
75
Run Growth:
38
Growth Rate:
50.67%
Total runs:
70
Run Growth:
0
Growth Rate:
0.00%
Total runs:
69
Run Growth:
50
Growth Rate:
72.46%
Total runs:
65
Run Growth:
8
Growth Rate:
13.56%
Total runs:
61
Run Growth:
-2
Growth Rate:
-3.28%
Total runs:
56
Run Growth:
32
Growth Rate:
57.14%
Total runs:
54
Run Growth:
15
Growth Rate:
28.30%
Total runs:
52
Run Growth:
-4
Growth Rate:
-8.33%
Total runs:
50
Run Growth:
3
Growth Rate:
6.12%
Total runs:
50
Run Growth:
8
Growth Rate:
16.67%
Total runs:
48
Run Growth:
-40
Growth Rate:
-83.33%
Total runs:
48
Run Growth:
-106
Growth Rate:
-220.83%
Total runs:
44
Run Growth:
-10
Growth Rate:
-22.73%
Total runs:
42
Run Growth:
13
Growth Rate:
30.95%
Total runs:
42
Run Growth:
15
Growth Rate:
35.71%
Total runs:
42
Run Growth:
20
Growth Rate:
47.62%
Total runs:
41
Run Growth:
3
Growth Rate:
7.32%
Total runs:
41
Run Growth:
17
Growth Rate:
42.50%
Total runs:
36
Run Growth:
18
Growth Rate:
50.00%
Total runs:
32
Run Growth:
21
Growth Rate:
65.63%
Total runs:
31
Run Growth:
18
Growth Rate:
58.06%
Total runs:
31
Run Growth:
10
Growth Rate:
32.26%
Total runs:
30
Run Growth:
-2
Growth Rate:
-6.67%
Total runs:
30
Run Growth:
12
Growth Rate:
40.00%
Total runs:
30
Run Growth:
18
Growth Rate:
60.00%
Total runs:
29
Run Growth:
13
Growth Rate:
44.83%
Total runs:
28
Run Growth:
16
Growth Rate:
55.17%
Total runs:
26
Run Growth:
8
Growth Rate:
30.77%
Total runs:
26
Run Growth:
7
Growth Rate:
26.92%
Total runs:
24
Run Growth:
2
Growth Rate:
8.33%
Total runs:
24
Run Growth:
-2
Growth Rate:
-8.33%
Total runs:
24
Run Growth:
7
Growth Rate:
29.17%
Total runs:
24
Run Growth:
12
Growth Rate:
57.14%
Total runs:
23
Run Growth:
-34
Growth Rate:
-147.83%
Total runs:
23
Run Growth:
14
Growth Rate:
60.87%
Total runs:
22
Run Growth:
14
Growth Rate:
63.64%
Total runs:
22
Run Growth:
-4
Growth Rate:
-17.39%
Total runs:
21
Run Growth:
-8
Growth Rate:
-38.10%
Total runs:
21
Run Growth:
10
Growth Rate:
47.62%
Total runs:
20
Run Growth:
-11
Growth Rate:
-52.38%
Total runs:
20
Run Growth:
-10
Growth Rate:
-50.00%
Total runs:
19
Run Growth:
-35
Growth Rate:
-184.21%
Total runs:
19
Run Growth:
12
Growth Rate:
60.00%
Total runs:
19
Run Growth:
8
Growth Rate:
40.00%
Total runs:
19
Run Growth:
-2
Growth Rate:
-10.53%
Total runs:
18
Run Growth:
11
Growth Rate:
55.00%
Total runs:
18
Run Growth:
3
Growth Rate:
15.79%
Total runs:
18
Run Growth:
12
Growth Rate:
66.67%
Total runs:
18
Run Growth:
4
Growth Rate:
22.22%
Total runs:
17
Run Growth:
0
Growth Rate:
0.00%
Total runs:
17
Run Growth:
-28
Growth Rate:
-155.56%
Total runs:
17
Run Growth:
6
Growth Rate:
35.29%
Total runs:
16
Run Growth:
8
Growth Rate:
44.44%
Total runs:
16
Run Growth:
-16
Growth Rate:
-100.00%
Total runs:
15
Run Growth:
11
Growth Rate:
68.75%
Total runs:
15
Run Growth:
4
Growth Rate:
26.67%
Total runs:
15
Run Growth:
1
Growth Rate:
6.67%
Total runs:
15
Run Growth:
2
Growth Rate:
13.33%
Total runs:
15
Run Growth:
4
Growth Rate:
26.67%
Total runs:
15
Run Growth:
4
Growth Rate:
26.67%
Total runs:
14
Run Growth:
-12
Growth Rate:
-85.71%
Total runs:
14
Run Growth:
0
Growth Rate:
0.00%
Total runs:
14
Run Growth:
6
Growth Rate:
42.86%
Total runs:
14
Run Growth:
3
Growth Rate:
21.43%
Total runs:
12
Run Growth:
-6
Growth Rate:
-50.00%
Total runs:
10
Run Growth:
-3
Growth Rate:
-30.00%
Total runs:
9
Run Growth:
-3
Growth Rate:
-33.33%
Total runs:
9
Run Growth:
-11
Growth Rate:
-110.00%
Total runs:
8
Run Growth:
3
Growth Rate:
37.50%
Total runs:
7
Run Growth:
4
Growth Rate:
57.14%
Total runs:
6
Run Growth:
1
Growth Rate:
16.67%
Total runs:
6
Run Growth:
-8
Growth Rate:
-133.33%
Total runs:
5
Run Growth:
5
Growth Rate:
100.00%
Total runs:
5
Run Growth:
2
Growth Rate:
40.00%
Total runs:
4
Run Growth:
1
Growth Rate:
25.00%