This is VT5 base fine-tuned on
Single-Page DocVQA
(SP-DocVQA) dataset using the
MP-DocVQA framework
.
VT5 is a version of the Hi-VT5 described in
MP-DocVQA paper
, arranged in a non-hierarchical paradigm (using only one page for each question-answer pair).
Before fine-tuning, we start from pre-trained
t5-base
for the language backbone, and pre-trained
DiT-base
to embed visual features (which we keep frozen during fine-tune phase).
This method is the base architecture for the PFL-DocVQA Competition that will will take place from the 1st of July to the 1st of November, 2023. If you are interested in Federated Learning and Differential Privacy we invite you to have a look at the
PFL-DocVQA
Challenge and Competition hold on these topics.
Runs of rubentito vt5-base-spdocvqa on huggingface.co
3
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
-57
30-day runs
More Information About vt5-base-spdocvqa huggingface.co Model
vt5-base-spdocvqa huggingface.co is an AI model on huggingface.co that provides vt5-base-spdocvqa's model effect (), which can be used instantly with this rubentito vt5-base-spdocvqa model. huggingface.co supports a free trial of the vt5-base-spdocvqa model, and also provides paid use of the vt5-base-spdocvqa. Support call vt5-base-spdocvqa model through api, including Node.js, Python, http.
vt5-base-spdocvqa huggingface.co is an online trial and call api platform, which integrates vt5-base-spdocvqa's modeling effects, including api services, and provides a free online trial of vt5-base-spdocvqa, you can try vt5-base-spdocvqa online for free by clicking the link below.
rubentito vt5-base-spdocvqa online free url in huggingface.co:
vt5-base-spdocvqa is an open source model from GitHub that offers a free installation service, and any user can find vt5-base-spdocvqa on GitHub to install. At the same time, huggingface.co provides the effect of vt5-base-spdocvqa install, users can directly use vt5-base-spdocvqa installed effect in huggingface.co for debugging and trial. It also supports api for free installation.