A high-efficiency layout area localization model trained on a self-built dataset of Chinese and English papers, magazines, and research reports using PicoDet-S. 17-Class Area Detection Model, including 17 common layout categories: Paragraph Title, Image, Text, Number, Abstract, Content, Figure Caption, Formula, Table, Table Caption, References, Document Title, Footnote, Header, Algorithm, Footer, and Seal. The key metrics are as follow:
Model
mAP(0.5) (%)
PicoDet-S_layout_17cls
87.4
Note
: Paddleocr's self built layout area detection data set contains 892 common document type images such as Chinese and English papers, magazines and research papers.
Quick Start
Installation
PaddlePaddle
Please refer to the following commands to install PaddlePaddle using pip:
# for CUDA11.8
python -m pip install paddlepaddle-gpu==3.0.0 -i https://www.paddlepaddle.org.cn/packages/stable/cu118/
# for CUDA12.6
python -m pip install paddlepaddle-gpu==3.0.0 -i https://www.paddlepaddle.org.cn/packages/stable/cu126/
# for CPU
python -m pip install paddlepaddle==3.0.0 -i https://www.paddlepaddle.org.cn/packages/stable/cpu/
You can also integrate the model inference of the layout detection module into your project. Before running the following code, please download the sample image to your local machine.
from paddleocr import LayoutDetection
model = LayoutDetection(model_name="PicoDet-S_layout_17cls")
output = model.predict("N5C68HPVAI-xQAWTxpbA6.jpeg", batch_size=1, layout_nms=True)
for res in output:
res.print()
res.save_to_img(save_path="./output/")
res.save_to_json(save_path="./output/res.json")
For details about usage command and descriptions of parameters, please refer to the
Document
.
Pipeline Usage
The ability of a single model is limited. But the pipeline consists of several models can provide more capacity to resolve difficult problems in real-world scenarios.
PP-TableMagic (table_recognition_v2)
The General Table Recognition v2 pipeline (PP-TableMagic) is designed to tackle table recognition tasks, identifying tables in images and outputting them in HTML format. PP-TableMagic includes the following 8 modules:
If save_path is specified, the visualization results will be saved under
save_path
.
The command-line method is for quick experience. For project integration, also only a few codes are needed as well:
from paddleocr import TableRecognitionPipelineV2
pipeline = TableRecognitionPipelineV2(
layout_detection_model_name=PicoDet-S_layout_17cls,
use_doc_orientation_classify=False, # Use use_doc_orientation_classify to enable/disable document orientation classification model
use_doc_unwarping=False, # Use use_doc_unwarping to enable/disable document unwarping module
device="gpu:0", # Use device to specify GPU for model inference
)
output = pipeline.predict("tuY1zoUdZsL6-9yGG0MpU.jpeg")
for res in output:
res.print() ## Print the predicted structured output
res.save_to_img("./output/")
res.save_to_xlsx("./output/")
res.save_to_html("./output/")
res.save_to_json("./output/")
The default model used in pipeline is
PP-DocLayout-L
, so it is needed that specifing to
PicoDet-S_layout_17cls
by argument
layout_detection_model_name
. And you can also use the local model file by argument
layout_detection_model_dir
. For details about usage command and descriptions of parameters, please refer to the
Document
.
PicoDet-S_layout_17cls huggingface.co is an AI model on huggingface.co that provides PicoDet-S_layout_17cls's model effect (), which can be used instantly with this PaddlePaddle PicoDet-S_layout_17cls model. huggingface.co supports a free trial of the PicoDet-S_layout_17cls model, and also provides paid use of the PicoDet-S_layout_17cls. Support call PicoDet-S_layout_17cls model through api, including Node.js, Python, http.
PicoDet-S_layout_17cls huggingface.co is an online trial and call api platform, which integrates PicoDet-S_layout_17cls's modeling effects, including api services, and provides a free online trial of PicoDet-S_layout_17cls, you can try PicoDet-S_layout_17cls online for free by clicking the link below.
PaddlePaddle PicoDet-S_layout_17cls online free url in huggingface.co:
PicoDet-S_layout_17cls is an open source model from GitHub that offers a free installation service, and any user can find PicoDet-S_layout_17cls on GitHub to install. At the same time, huggingface.co provides the effect of PicoDet-S_layout_17cls install, users can directly use PicoDet-S_layout_17cls installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
PicoDet-S_layout_17cls install url in huggingface.co: