We introduce
MultiUI
, a dataset containing 7.3 million samples from 1 million websites, covering diverse multi- modal tasks and UI layouts. Models trained on
MultiUI
not only excel in web UI tasks—achieving up to a 48% improvement on VisualWebBench and a 19.1% boost in action accuracy on a web agent dataset Mind2Web—but also generalize surprisingly well to non-web UI tasks and even to non-UI domains, such as document understanding, OCR, and chart interpretation.
If you find this work helpful, please cite out paper:
@misc{liu2024harnessingwebpageuistextrich,
title={Harnessing Webpage UIs for Text-Rich Visual Understanding},
author={Junpeng Liu and Tianyue Ou and Yifan Song and Yuxiao Qu and Wai Lam and Chenyan Xiong and Wenhu Chen and Graham Neubig and Xiang Yue},
year={2024},
eprint={2410.13824},
archivePrefix={arXiv},
primaryClass={cs.CV},
url={https://arxiv.org/abs/2410.13824},
}
Runs of neulab UIX-Qwen2 on huggingface.co
9
Total runs
0
24-hour runs
0
3-day runs
1
7-day runs
1
30-day runs
More Information About UIX-Qwen2 huggingface.co Model
UIX-Qwen2 huggingface.co is an AI model on huggingface.co that provides UIX-Qwen2's model effect (), which can be used instantly with this neulab UIX-Qwen2 model. huggingface.co supports a free trial of the UIX-Qwen2 model, and also provides paid use of the UIX-Qwen2. Support call UIX-Qwen2 model through api, including Node.js, Python, http.
UIX-Qwen2 huggingface.co is an online trial and call api platform, which integrates UIX-Qwen2's modeling effects, including api services, and provides a free online trial of UIX-Qwen2, you can try UIX-Qwen2 online for free by clicking the link below.
neulab UIX-Qwen2 online free url in huggingface.co:
UIX-Qwen2 is an open source model from GitHub that offers a free installation service, and any user can find UIX-Qwen2 on GitHub to install. At the same time, huggingface.co provides the effect of UIX-Qwen2 install, users can directly use UIX-Qwen2 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.