Sponsored by
APIMart
AlexWortega / ruImagecaptioning
Model's Last Updated: May 20 2022
Introduction of ruImagecaptioning
Model Details of ruImagecaptioning
ruImageCaptioning
Inference Notebook:
Русская версия CLIP prefix caption, обученная на ruGPTSMALL + CLIP(OPENAI), можно использовать для VQA, image captioning и прочее. Модель работает <1c + ее можно эффективно квантануть/перенести в ONNX. Обучалось в течении 3х дней на 2*1080ti
Trained and validated on ruCOCO BLEU: 37.3
chrF: 32.4
ROUGE-1-F: 33.0
ROUGE-2-F: 14.1
ROUGE-L-F: 30.3
THIS WORK IS BASED ON https://github.com/rmokady/CLIP_prefix_caption (english version)
@article{mokady2021clipcap,
title={ClipCap: CLIP Prefix for Image Captioning},
author={Mokady, Ron and Hertz, Amir and Bermano, Amit H},
journal={arXiv preprint arXiv:2111.09734},
year={2021}
}
@article{AlexWortega,
title={ruImage captioning},
author={Aleksandr Nikolic, Asta gpu server },
}
Acknowledgments
This repository is heavily based on CLIP and Hugging-faces repositories. For training we used the data of COCO dataset and Conceptual Captions translated by ALEX WORTEGA ruCOCO
Runs of AlexWortega ruImagecaptioning on huggingface.co
0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About ruImagecaptioning huggingface.co Model
Url of ruImagecaptioning
ruImagecaptioning huggingface.co Url
Provider of ruImagecaptioning huggingface.co
Other API from AlexWortega
Total runs:
1.4K
Run Growth:
1.2K
Growth Rate:
82.62%
Total runs:
1.2K
Run Growth:
1.2K
Growth Rate:
95.07%
Total runs:
782
Run Growth:
612
Growth Rate:
78.26%
Total runs:
496
Run Growth:
116
Growth Rate:
23.39%
Total runs:
495
Run Growth:
336
Growth Rate:
67.88%
Total runs:
413
Run Growth:
-713
Growth Rate:
-172.64%
Total runs:
188
Run Growth:
103
Growth Rate:
54.79%
Total runs:
172
Run Growth:
-378
Growth Rate:
-219.77%
Total runs:
151
Run Growth:
-131
Growth Rate:
-86.75%
Total runs:
145
Run Growth:
145
Growth Rate:
100.00%
Total runs:
128
Run Growth:
51
Growth Rate:
42.50%
Total runs:
127
Run Growth:
-56
Growth Rate:
-44.09%
Total runs:
95
Run Growth:
22
Growth Rate:
23.16%
Total runs:
78
Run Growth:
-38
Growth Rate:
-48.72%
Total runs:
75
Run Growth:
-102
Growth Rate:
-136.00%
Total runs:
58
Run Growth:
-52
Growth Rate:
-89.66%
Total runs:
29
Run Growth:
10
Growth Rate:
34.48%
Total runs:
24
Run Growth:
-71
Growth Rate:
-295.83%
Total runs:
23
Run Growth:
3
Growth Rate:
13.04%
Total runs:
20
Run Growth:
5
Growth Rate:
25.00%
Total runs:
18
Run Growth:
3
Growth Rate:
16.67%
Total runs:
17
Run Growth:
3
Growth Rate:
17.65%
Total runs:
17
Run Growth:
-1
Growth Rate:
-5.88%
Total runs:
16
Run Growth:
-4
Growth Rate:
-25.00%
Total runs:
11
Run Growth:
4
Growth Rate:
36.36%
Total runs:
11
Run Growth:
-2
Growth Rate:
-18.18%
Total runs:
10
Run Growth:
-6
Growth Rate:
-60.00%
Total runs:
9
Run Growth:
5
Growth Rate:
55.56%
Total runs:
7
Run Growth:
3
Growth Rate:
42.86%
Total runs:
7
Run Growth:
0
Growth Rate:
0.00%
Total runs:
6
Run Growth:
1
Growth Rate:
16.67%
Total runs:
6
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
-1
Growth Rate:
-20.00%
Total runs:
3
Run Growth:
-1
Growth Rate:
-33.33%
Total runs:
1
Run Growth:
-7
Growth Rate:
-700.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%