Total runs:
105.9K
Run Growth:
2.7K
Growth Rate:
2.53%
Sponsored by
PoYo.AI
philschmid / donut-base-finetuned-cord-v2
Model's Last Updated: October 18 2022
image-to-text
Introduction of donut-base-finetuned-cord-v2
Model Details of donut-base-finetuned-cord-v2
Fork of naver-clova-ix/donut-base-finetuned-cord-v2
This is fork of naver-clova-ix/donut-base-finetuned-cord-v2 implementing a custom
handler.pyas an example for how to usedonutmodels with inference-endpoints
Donut (base-sized model, fine-tuned on CORD)
Donut model fine-tuned on CORD. It was introduced in the paper OCR-free Document Understanding Transformer by Geewok et al. and first released in this repository .
Donut consists of a vision encoder (Swin Transformer) and a text decoder (BART). Given an image, the encoder first encodes the image into a tensor of embeddings (of shape batch_size, seq_len, hidden_size), after which the decoder autoregressively generates text, conditioned on the encoding of the encoder.
Use with Inference Endpoints
Hugging Face Inference endpoints can directly work with binary data, this means that we can directly send our image from our document to the endpoint. We are going to use requests to send our requests. (make your you have it installed
pip install requests
)
Send requests with Pyton
load sample image
wget https://huggingface.co/philschmid/donut-base-finetuned-cord-v2/resolve/main/sample.png
send request to endpoint
import json
import requests as r
import mimetypes
ENDPOINT_URL="" # url of your endpoint
HF_TOKEN="" # organization token where you deployed your endpoint
def predict(path_to_image:str=None):
with open(path_to_image, "rb") as i:
b = i.read()
headers= {
"Authorization": f"Bearer {HF_TOKEN}",
"Content-Type": mimetypes.guess_type(path_to_image)[0]
}
response = r.post(ENDPOINT_URL, headers=headers, data=b)
return response.json()
prediction = predict(path_to_image="sample.png")
print(prediction)
# {'menu': [{'nm': '0571-1854 BLUS WANITA',
# 'unitprice': '@120.000',
# 'cnt': '1',
# 'price': '120,000'},
# {'nm': '1002-0060 SHOPPING BAG', 'cnt': '1', 'price': '0'}],
# 'total': {'total_price': '120,000',
# 'changeprice': '0',
# 'creditcardprice': '120,000',
# 'menuqty_cnt': '1'}}
curl example
curl https://ak7gduay2ypyr9vp.us-east-1.aws.endpoints.huggingface.cloud \
-X POST \
--data-binary 'sample.png' \
-H "Authorization: Bearer XXX" \
-H "Content-Type: null"
Runs of philschmid donut-base-finetuned-cord-v2 on huggingface.co
42
Total runs
1
24-hour runs
5
3-day runs
12
7-day runs
17
30-day runs
More Information About donut-base-finetuned-cord-v2 huggingface.co Model
Url of donut-base-finetuned-cord-v2
donut-base-finetuned-cord-v2 huggingface.co Url
Provider of donut-base-finetuned-cord-v2 huggingface.co
Other API from philschmid
Updated:December 24 2022
Total runs:
8.1K
Run Growth:
-4.9K
Growth Rate:
-60.25%
Total runs:
4.1K
Run Growth:
-1.1K
Growth Rate:
-27.31%
Total runs:
3.1K
Run Growth:
864
Growth Rate:
27.38%
Total runs:
2.4K
Run Growth:
-1.3K
Growth Rate:
-54.03%
Total runs:
2.1K
Run Growth:
-1.3K
Growth Rate:
-61.67%
Total runs:
1.8K
Run Growth:
161
Growth Rate:
8.76%
Total runs:
1.6K
Run Growth:
-706
Growth Rate:
-37.12%
Total runs:
1.6K
Run Growth:
-372
Growth Rate:
-23.74%
Total runs:
844
Run Growth:
-28
Growth Rate:
-3.32%
Total runs:
595
Run Growth:
-153
Growth Rate:
-26.38%
Total runs:
172
Run Growth:
77
Growth Rate:
44.77%
Total runs:
139
Run Growth:
111
Growth Rate:
79.86%
Total runs:
127
Run Growth:
48
Growth Rate:
37.80%
Total runs:
125
Run Growth:
45
Growth Rate:
39.13%
Total runs:
117
Run Growth:
64
Growth Rate:
53.78%
Total runs:
114
Run Growth:
-218
Growth Rate:
-191.23%
Total runs:
109
Run Growth:
-7
Growth Rate:
-6.36%
Total runs:
106
Run Growth:
97
Growth Rate:
91.51%
Total runs:
95
Run Growth:
0
Growth Rate:
0.00%
Total runs:
82
Run Growth:
1
Growth Rate:
1.22%
Total runs:
77
Run Growth:
-26
Growth Rate:
-29.55%
Total runs:
76
Run Growth:
20
Growth Rate:
26.32%
Total runs:
74
Run Growth:
51
Growth Rate:
72.86%
Total runs:
72
Run Growth:
65
Growth Rate:
90.28%
Total runs:
70
Run Growth:
0
Growth Rate:
0.00%
Total runs:
68
Run Growth:
63
Growth Rate:
92.65%
Total runs:
63
Run Growth:
43
Growth Rate:
68.25%
Total runs:
62
Run Growth:
49
Growth Rate:
79.03%
Total runs:
61
Run Growth:
52
Growth Rate:
85.25%
Total runs:
61
Run Growth:
55
Growth Rate:
90.16%
Total runs:
57
Run Growth:
20
Growth Rate:
35.71%
Total runs:
55
Run Growth:
50
Growth Rate:
90.91%
Total runs:
54
Run Growth:
16
Growth Rate:
32.00%
Total runs:
48
Run Growth:
21
Growth Rate:
44.68%
Total runs:
46
Run Growth:
42
Growth Rate:
91.30%
Total runs:
44
Run Growth:
-10
Growth Rate:
-22.73%
Total runs:
43
Run Growth:
33
Growth Rate:
82.50%
Total runs:
42
Run Growth:
-6
Growth Rate:
-14.29%
Total runs:
40
Run Growth:
32
Growth Rate:
80.00%
Total runs:
39
Run Growth:
35
Growth Rate:
89.74%
Total runs:
38
Run Growth:
11
Growth Rate:
29.73%
Total runs:
38
Run Growth:
30
Growth Rate:
78.95%
Total runs:
37
Run Growth:
32
Growth Rate:
86.49%
Total runs:
37
Run Growth:
24
Growth Rate:
63.16%
Total runs:
36
Run Growth:
20
Growth Rate:
55.56%
Total runs:
31
Run Growth:
24
Growth Rate:
77.42%
Total runs:
30
Run Growth:
12
Growth Rate:
40.00%
Total runs:
29
Run Growth:
20
Growth Rate:
71.43%
Total runs:
28
Run Growth:
16
Growth Rate:
57.14%
Total runs:
28
Run Growth:
14
Growth Rate:
51.85%
Total runs:
27
Run Growth:
16
Growth Rate:
59.26%
Total runs:
27
Run Growth:
21
Growth Rate:
77.78%
Total runs:
27
Run Growth:
11
Growth Rate:
42.31%
Total runs:
26
Run Growth:
22
Growth Rate:
84.62%
Total runs:
24
Run Growth:
12
Growth Rate:
50.00%
Total runs:
22
Run Growth:
-25
Growth Rate:
-125.00%
Total runs:
22
Run Growth:
17
Growth Rate:
77.27%
Total runs:
22
Run Growth:
2
Growth Rate:
9.52%
Total runs:
21
Run Growth:
12
Growth Rate:
57.14%
Total runs:
20
Run Growth:
8
Growth Rate:
42.11%
Total runs:
19
Run Growth:
13
Growth Rate:
68.42%
Total runs:
19
Run Growth:
11
Growth Rate:
61.11%
Total runs:
19
Run Growth:
6
Growth Rate:
31.58%
Total runs:
18
Run Growth:
4
Growth Rate:
22.22%
Total runs:
18
Run Growth:
11
Growth Rate:
57.89%
Total runs:
18
Run Growth:
8
Growth Rate:
44.44%
Total runs:
17
Run Growth:
12
Growth Rate:
70.59%
Total runs:
17
Run Growth:
13
Growth Rate:
76.47%
Total runs:
16
Run Growth:
9
Growth Rate:
56.25%
Total runs:
16
Run Growth:
8
Growth Rate:
50.00%
Total runs:
16
Run Growth:
8
Growth Rate:
50.00%
Total runs:
16
Run Growth:
8
Growth Rate:
50.00%
Total runs:
15
Run Growth:
12
Growth Rate:
80.00%
Total runs:
15
Run Growth:
6
Growth Rate:
40.00%
Total runs:
15
Run Growth:
11
Growth Rate:
73.33%
Total runs:
15
Run Growth:
-3
Growth Rate:
-20.00%
Total runs:
15
Run Growth:
10
Growth Rate:
71.43%
Total runs:
15
Run Growth:
-7
Growth Rate:
-46.67%
Total runs:
14
Run Growth:
10
Growth Rate:
71.43%
Total runs:
14
Run Growth:
5
Growth Rate:
35.71%
Total runs:
13
Run Growth:
6
Growth Rate:
46.15%
Total runs:
13
Run Growth:
6
Growth Rate:
46.15%
Total runs:
12
Run Growth:
7
Growth Rate:
58.33%
Total runs:
12
Run Growth:
-6
Growth Rate:
-50.00%
Total runs:
11
Run Growth:
-17
Growth Rate:
-154.55%
Total runs:
10
Run Growth:
3
Growth Rate:
30.00%
Total runs:
10
Run Growth:
-3
Growth Rate:
-30.00%
Total runs:
8
Run Growth:
3
Growth Rate:
37.50%
Total runs:
7
Run Growth:
4
Growth Rate:
57.14%
Total runs:
6
Run Growth:
1
Growth Rate:
16.67%
Total runs:
6
Run Growth:
-8
Growth Rate:
-133.33%
Total runs:
5
Run Growth:
5
Growth Rate:
100.00%
Total runs:
5
Run Growth:
2
Growth Rate:
40.00%
Total runs:
4
Run Growth:
1
Growth Rate:
25.00%