Total runs:
1.6K
Run Growth:
1.4K
Growth Rate:
90.65%
Sponsored by
YouArt
flax-community / dalle-mini
Model's Last Updated: August 17 2021
text-to-image
Introduction of dalle-mini
Model Details of dalle-mini
DALL·E mini - Generate images from text
Model Description
This is an attempt to replicate OpenAI's DALL·E , a model capable of generating arbitrary images from a text prompt that describes the desired result.
This model's architecture is a simplification of the original, and leverages previous open source efforts and available pre-trained models. Results have lower quality than OpenAI's, but the model can be trained and used on less demanding hardware. Our training was performed on a single TPU v3-8 for a few days.
Components of the Architecture
The system relies on the Flax/JAX infrastructure, which are ideal for TPU training. TPUs are not required, both Flax and JAX run very efficiently on GPU backends.
The main components of the architecture include:
-
An encoder, based on BART . The encoder transforms a sequence of input text tokens to a sequence of image tokens. The input tokens are extracted from the text prompt by using the model's tokenizer. The image tokens are a fixed-length sequence, and they represent indices in a VQGAN-based pre-trained codebook.
-
A decoder, which converts the image tokens to image pixels. As mentioned above, the decoder is based on a VQGAN model .
The model definition we use for the encoder can be downloaded from our
Github repo
. The encoder is represented by the class
CustomFlaxBartForConditionalGeneration
.
To use the decoder, you need to follow the instructions in our accompanying VQGAN model in the hub, flax-community/vqgan_f16_16384 .
How to Use
The easiest way to get familiar with the code and the models is to follow the inference notebook we provide in our
github repo
. For your convenience, you can open it in Google Colaboratory:
If you just want to test the trained model and see what it comes up with, please visit our demo , available in 🤗 Spaces.
Additional Details
Our report contains more details about how the model was trained and shows many examples that demonstrate its capabilities.
Runs of flax-community dalle-mini on huggingface.co
74
Total runs
0
24-hour runs
2
3-day runs
-23
7-day runs
30
30-day runs
More Information About dalle-mini huggingface.co Model
Url of dalle-mini
dalle-mini huggingface.co Url
Provider of dalle-mini huggingface.co
Other API from flax-community
Updated:July 17 2021
Total runs:
1.3K
Run Growth:
819
Growth Rate:
62.76%
Total runs:
1.2K
Run Growth:
-942
Growth Rate:
-78.17%
Total runs:
795
Run Growth:
579
Growth Rate:
73.95%
Total runs:
782
Run Growth:
-85
Growth Rate:
-11.04%
Total runs:
466
Run Growth:
-181
Growth Rate:
-39.78%
Total runs:
278
Run Growth:
117
Growth Rate:
43.66%
Total runs:
252
Run Growth:
-344
Growth Rate:
-139.27%
Total runs:
251
Run Growth:
57
Growth Rate:
22.27%
Total runs:
226
Run Growth:
215
Growth Rate:
95.98%
Total runs:
175
Run Growth:
57
Growth Rate:
33.73%
Total runs:
148
Run Growth:
-55
Growth Rate:
-37.41%
Total runs:
147
Run Growth:
41
Growth Rate:
28.87%
Total runs:
147
Run Growth:
43
Growth Rate:
30.28%
Total runs:
130
Run Growth:
31
Growth Rate:
24.60%
Total runs:
126
Run Growth:
56
Growth Rate:
42.42%
Total runs:
121
Run Growth:
18
Growth Rate:
15.52%
Total runs:
120
Run Growth:
104
Growth Rate:
88.14%
Total runs:
108
Run Growth:
87
Growth Rate:
83.65%
Total runs:
101
Run Growth:
65
Growth Rate:
65.66%
Total runs:
99
Run Growth:
-2
Growth Rate:
-2.11%
Total runs:
71
Run Growth:
54
Growth Rate:
76.06%
Total runs:
70
Run Growth:
20
Growth Rate:
31.25%
Total runs:
66
Run Growth:
-2
Growth Rate:
-3.17%
Total runs:
65
Run Growth:
53
Growth Rate:
80.30%
Total runs:
55
Run Growth:
44
Growth Rate:
81.48%
Total runs:
55
Run Growth:
45
Growth Rate:
83.33%
Total runs:
54
Run Growth:
30
Growth Rate:
55.56%
Total runs:
52
Run Growth:
31
Growth Rate:
60.78%
Total runs:
51
Run Growth:
38
Growth Rate:
76.00%
Total runs:
48
Run Growth:
38
Growth Rate:
80.85%
Total runs:
43
Run Growth:
21
Growth Rate:
48.84%
Total runs:
39
Run Growth:
16
Growth Rate:
41.03%
Total runs:
35
Run Growth:
0
Growth Rate:
0.00%
Total runs:
34
Run Growth:
24
Growth Rate:
70.59%
Total runs:
33
Run Growth:
3
Growth Rate:
9.38%
Total runs:
31
Run Growth:
25
Growth Rate:
80.65%
Total runs:
30
Run Growth:
12
Growth Rate:
40.00%
Total runs:
29
Run Growth:
21
Growth Rate:
75.00%
Total runs:
27
Run Growth:
17
Growth Rate:
65.38%
Total runs:
26
Run Growth:
6
Growth Rate:
24.00%
Total runs:
25
Run Growth:
1
Growth Rate:
4.00%
Total runs:
25
Run Growth:
12
Growth Rate:
48.00%
Total runs:
24
Run Growth:
11
Growth Rate:
47.83%
Total runs:
24
Run Growth:
16
Growth Rate:
66.67%
Total runs:
23
Run Growth:
-33
Growth Rate:
-150.00%
Total runs:
22
Run Growth:
13
Growth Rate:
59.09%
Total runs:
22
Run Growth:
5
Growth Rate:
22.73%
Total runs:
22
Run Growth:
14
Growth Rate:
63.64%
Total runs:
22
Run Growth:
13
Growth Rate:
54.17%
Total runs:
21
Run Growth:
15
Growth Rate:
71.43%
Total runs:
21
Run Growth:
13
Growth Rate:
61.90%
Total runs:
21
Run Growth:
13
Growth Rate:
61.90%
Total runs:
20
Run Growth:
14
Growth Rate:
70.00%
Total runs:
20
Run Growth:
-25
Growth Rate:
-125.00%
Total runs:
20
Run Growth:
11
Growth Rate:
55.00%
Total runs:
19
Run Growth:
10
Growth Rate:
52.63%
Total runs:
19
Run Growth:
14
Growth Rate:
70.00%
Total runs:
19
Run Growth:
8
Growth Rate:
42.11%
Total runs:
18
Run Growth:
-7
Growth Rate:
-41.18%
Total runs:
18
Run Growth:
11
Growth Rate:
64.71%
Total runs:
17
Run Growth:
4
Growth Rate:
23.53%
Total runs:
17
Run Growth:
10
Growth Rate:
58.82%
Total runs:
17
Run Growth:
15
Growth Rate:
88.24%
Total runs:
16
Run Growth:
6
Growth Rate:
37.50%
Total runs:
16
Run Growth:
8
Growth Rate:
50.00%
Total runs:
16
Run Growth:
5
Growth Rate:
31.25%
Total runs:
15
Run Growth:
6
Growth Rate:
42.86%
Total runs:
15
Run Growth:
7
Growth Rate:
46.67%
Total runs:
15
Run Growth:
8
Growth Rate:
53.33%
Total runs:
14
Run Growth:
5
Growth Rate:
35.71%
Total runs:
14
Run Growth:
10
Growth Rate:
71.43%
Total runs:
14
Run Growth:
4
Growth Rate:
30.77%
Total runs:
14
Run Growth:
6
Growth Rate:
42.86%
Total runs:
13
Run Growth:
2
Growth Rate:
15.38%
Total runs:
13
Run Growth:
-30
Growth Rate:
-230.77%
Total runs:
12
Run Growth:
2
Growth Rate:
16.67%
Total runs:
12
Run Growth:
4
Growth Rate:
33.33%
Total runs:
11
Run Growth:
0
Growth Rate:
0.00%
Total runs:
11
Run Growth:
6
Growth Rate:
54.55%
Total runs:
11
Run Growth:
-1
Growth Rate:
-10.00%
Total runs:
11
Run Growth:
5
Growth Rate:
45.45%
Total runs:
10
Run Growth:
3
Growth Rate:
30.00%
Total runs:
10
Run Growth:
-5
Growth Rate:
-50.00%
Total runs:
10
Run Growth:
5
Growth Rate:
50.00%
Total runs:
10
Run Growth:
4
Growth Rate:
40.00%
Total runs:
10
Run Growth:
-5
Growth Rate:
-50.00%
Total runs:
10
Run Growth:
3
Growth Rate:
30.00%