Total runs:
212.8K
Run Growth:
133.2K
Growth Rate:
62.61%
Sponsored by
Tripo AI
ByteDance / Dolphin-1.5
Model's Last Updated: November 12 2025
image-text-to-text
Introduction of Dolphin-1.5
Model Details of Dolphin-1.5
Dolphin: Document Image Parsing via Heterogeneous Anchor Prompting
Model Description
Dolphin ( Do cument Image P arsing via H eterogeneous Anchor Prompt in g) is a novel multimodal document image parsing model that follows an analyze-then-parse paradigm. It addresses the challenges of complex document understanding through a two-stage approach designed to handle intertwined elements such as text paragraphs, figures, formulas, and tables.
📑 Overview
Document image parsing is challenging due to its complexly intertwined elements such as text paragraphs, figures, formulas, and tables. Dolphin addresses these challenges through a two-stage approach:
- 🔍 Stage 1 : Comprehensive page-level layout analysis by generating element sequence in natural reading order
- 🧩 Stage 2 : Efficient parallel parsing of document elements using heterogeneous anchors and task-specific prompts
Dolphin achieves promising performance across diverse page-level and element-level parsing tasks while ensuring superior efficiency through its lightweight architecture and parallel parsing mechanism.
Model Architecture
Dolphin is built on a vision-encoder-decoder architecture using transformers:
- Vision Encoder : Based on Swin Transformer for extracting visual features from document images
- Text Decoder : Based on MBart for decoding text from visual features
- Prompt-based interface : Uses natural language prompts to control parsing tasks
The model is implemented as a Hugging Face
VisionEncoderDecoderModel
for easy integration with the Transformers ecosystem.
Usage
Our demo will be released in these days. Please keep tuned! 🔥
Please refer to our GitHub repository for detailed usage.
- Page-wise parsing : for an entire document image
- Element-wise parsing : for an element (paragraph, table, formula) image
License
This model is released under the MIT License.
Citation
@inproceedings{dolphin2025,
title={Dolphin: Document Image Parsing via Heterogeneous Anchor Prompting},
author={Feng, Hao and Wei, Shu and Fei, Xiang and Shi, Wei and Han, Yingdong and Liao, Lei and Lu, Jinghui and Wu, Binghong and Liu, Qi and Lin, Chunhui and Tang, Jingqun and Liu, Hao and Huang, Can},
year={2025},
booktitle={Proceedings of the 65rd Annual Meeting of the Association for Computational Linguistics (ACL)}
}
Acknowledgements
This model builds on several open-source projects including:
Runs of ByteDance Dolphin-1.5 on huggingface.co
548
Total runs
9
24-hour runs
85
3-day runs
208
7-day runs
17
30-day runs
More Information About Dolphin-1.5 huggingface.co Model
Url of Dolphin-1.5
Dolphin-1.5 huggingface.co Url
Provider of Dolphin-1.5 huggingface.co
Other API from ByteDance
Updated:June 12 2025
Total runs:
81.4K
Run Growth:
-3.9K
Growth Rate:
-4.80%
Total runs:
45.9K
Run Growth:
24.6K
Growth Rate:
53.59%
Total runs:
22.5K
Run Growth:
-6.5K
Growth Rate:
-29.01%
Total runs:
15.4K
Run Growth:
2.6K
Growth Rate:
16.56%
Total runs:
11.0K
Run Growth:
7.0K
Growth Rate:
63.94%
Total runs:
7.2K
Run Growth:
-1.0K
Growth Rate:
-13.99%
Total runs:
1.0K
Run Growth:
396
Growth Rate:
37.93%
Total runs:
639
Run Growth:
519
Growth Rate:
81.22%
Total runs:
140
Run Growth:
81
Growth Rate:
57.86%
Total runs:
125
Run Growth:
56
Growth Rate:
44.80%
Total runs:
103
Run Growth:
27
Growth Rate:
26.21%
Total runs:
98
Run Growth:
55
Growth Rate:
56.12%
Total runs:
83
Run Growth:
-10
Growth Rate:
-12.05%
Total runs:
67
Run Growth:
2
Growth Rate:
2.99%
Total runs:
66
Run Growth:
43
Growth Rate:
65.15%
Total runs:
34
Run Growth:
-10
Growth Rate:
-29.41%
Total runs:
22
Run Growth:
-17
Growth Rate:
-77.27%
Total runs:
9
Run Growth:
-14
Growth Rate:
-155.56%
Total runs:
7
Run Growth:
-8
Growth Rate:
-114.29%
Total runs:
4
Run Growth:
-11
Growth Rate:
-275.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%