Tingquan's picture
Add tag: layout_detection
bc61050 verified
---
license: apache-2.0
library_name: PaddleOCR
language:
- en
- zh
pipeline_tag: image-to-text
tags:
- OCR
- PaddlePaddle
- PaddleOCR
- layout_detection
---
# PicoDet-L_layout_17cls
## Introduction
A balanced efficiency and precision layout area localization model trained on a self-built dataset of Chinese and English papers, magazines, and research reports using PicoDet-L, including 17 common layout categories: Paragraph Title, Image, Text, Number, Abstract, Content, Figure Caption, Formula, Table, Table Caption, References, Document Title, Footnote, Header, Algorithm, Footer, and Seal.
| Model| mAP(0.5) (%) |
| --- | --- |
|PicoDet-L_layout_17cls | 89.0 |
**Note**: Paddleocr's self built layout area detection data set contains 892 common document type images such as Chinese and English papers, magazines and research papers.
## Quick Start
### Installation
1. PaddlePaddle
Please refer to the following commands to install PaddlePaddle using pip:
```bash
# for CUDA11.8
python -m pip install paddlepaddle-gpu==3.0.0 -i https://www.paddlepaddle.org.cn/packages/stable/cu118/
# for CUDA12.6
python -m pip install paddlepaddle-gpu==3.0.0 -i https://www.paddlepaddle.org.cn/packages/stable/cu126/
# for CPU
python -m pip install paddlepaddle==3.0.0 -i https://www.paddlepaddle.org.cn/packages/stable/cpu/
```
For details about PaddlePaddle installation, please refer to the [PaddlePaddle official website](https://www.paddlepaddle.org.cn/en/install/quick).
2. PaddleOCR
Install the latest version of the PaddleOCR inference package from PyPI:
```bash
python -m pip install paddleocr
```
### Model Usage
You can quickly experience the functionality with a single command:
```bash
paddleocr layout_detection \
--model_name PicoDet-L_layout_17cls \
--threshold 0.6 \
-i https://cdn-uploads.huggingface.co/production/uploads/63d7b8ee07cd1aa3c49a2026/N5C68HPVAI-xQAWTxpbA6.jpeg
```
You can also integrate the model inference of the layout detection module into your project. Before running the following code, please download the sample image to your local machine.
```python
from paddleocr import LayoutDetection
model = LayoutDetection(model_name="PicoDet-L_layout_17cls")
output = model.predict("N5C68HPVAI-xQAWTxpbA6.jpeg", batch_size=1, threshold=0.6)
for res in output:
res.print()
res.save_to_img(save_path="./output/")
res.save_to_json(save_path="./output/res.json")
```
After running, the obtained result is as follows:
```json
{'res': {'input_path': '/root/.paddlex/predict_input/N5C68HPVAI-xQAWTxpbA6.jpeg', 'page_index': None, 'boxes': [{'cls_id': 2, 'label': 'text', 'score': 0.9635457992553711, 'coordinate': [388.77502, 734.85455, 711.20465, 851.34924]}, {'cls_id': 2, 'label': 'text', 'score': 0.9560548067092896, 'coordinate': [35.81832, 645.7974, 361.34726, 849.03186]}, {'cls_id': 8, 'label': 'table', 'score': 0.953098714351654, 'coordinate': [436.3866, 107.82475, 663.87585, 313.641]}, {'cls_id': 8, 'label': 'table', 'score': 0.9468971490859985, 'coordinate': [74.18633, 105.53037, 324.5257, 298.42532]}, {'cls_id': 2, 'label': 'text', 'score': 0.9267896413803101, 'coordinate': [380.26923, 22.14476, 711.83966, 79.47579]}, {'cls_id': 2, 'label': 'text', 'score': 0.9177922606468201, 'coordinate': [386.36615, 498.08298, 713.29956, 698.7275]}, {'cls_id': 2, 'label': 'text', 'score': 0.9103341698646545, 'coordinate': [33.40257, 349.2482, 361.91498, 615.99664]}, {'cls_id': 2, 'label': 'text', 'score': 0.9034966230392456, 'coordinate': [36.185455, 332.4166, 144.946, 345.4999]}, {'cls_id': 2, 'label': 'text', 'score': 0.8902557492256165, 'coordinate': [385.55212, 347.35916, 715.6368, 460.86615]}, {'cls_id': 2, 'label': 'text', 'score': 0.7871182560920715, 'coordinate': [34.448185, 628.47015, 188.9675, 640.77356]}, {'cls_id': 2, 'label': 'text', 'score': 0.7396460771560669, 'coordinate': [428.26053, 477.82913, 692.68634, 490.73227]}, {'cls_id': 2, 'label': 'text', 'score': 0.7116910219192505, 'coordinate': [33.61207, 21.087503, 360.95645, 80.145096]}, {'cls_id': 0, 'label': 'paragraph_title', 'score': 0.6801344752311707, 'coordinate': [394.5478, 716.9035, 526.30695, 730.278]}]}}
```
The visualized image is as follows:
![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/63d7b8ee07cd1aa3c49a2026/Yx51k75B7ZQR5zMzdN-XU.jpeg)
For details about usage command and descriptions of parameters, please refer to the [Document](https://paddlepaddle.github.io/PaddleOCR/latest/en/version3.x/module_usage/layout_detection.html#iii-quick-integration).
### Pipeline Usage
The ability of a single model is limited. But the pipeline consists of several models can provide more capacity to resolve difficult problems in real-world scenarios.
#### PP-TableMagic (table_recognition_v2)
The General Table Recognition v2 pipeline (PP-TableMagic) is designed to tackle table recognition tasks, identifying tables in images and outputting them in HTML format. PP-TableMagic includes the following 8 modules:
* Table Structure Recognition Module
* Table Classification Module
* Table Cell Detection Module
* Text Detection Module
* Text Recognition Module
* Layout Region Detection Module (optional)
* Document Image Orientation Classification Module (optional)
* Text Image Unwarping Module (optional)
You can quickly experience the PP-TableMagic pipeline with a single command.
```bash
paddleocr table_recognition_v2 -i https://cdn-uploads.huggingface.co/production/uploads/63d7b8ee07cd1aa3c49a2026/tuY1zoUdZsL6-9yGG0MpU.jpeg \
--layout_detection_model_name PicoDet-L_layout_17cls \
--use_doc_orientation_classify False \
--use_doc_unwarping False \
--save_path ./output \
--device gpu:0
```
If save_path is specified, the visualization results will be saved under `save_path`.
The command-line method is for quick experience. For project integration, also only a few codes are needed as well:
```python
from paddleocr import TableRecognitionPipelineV2
pipeline = TableRecognitionPipelineV2(
layout_detection_model_name=PicoDet-L_layout_17cls,
use_doc_orientation_classify=False, # Use use_doc_orientation_classify to enable/disable document orientation classification model
use_doc_unwarping=False, # Use use_doc_unwarping to enable/disable document unwarping module
device="gpu:0", # Use device to specify GPU for model inference
)
output = pipeline.predict("tuY1zoUdZsL6-9yGG0MpU.jpeg")
for res in output:
res.print() ## Print the predicted structured output
res.save_to_img("./output/")
res.save_to_xlsx("./output/")
res.save_to_html("./output/")
res.save_to_json("./output/")
```
The default model used in pipeline is `PP-DocLayout-L`, so it is needed that specifing to `PicoDet-L_layout_17cls` by argument `layout_detection_model_name`. And you can also use the local model file by argument `layout_detection_model_dir`. For details about usage command and descriptions of parameters, please refer to the [Document](https://paddlepaddle.github.io/PaddleOCR/main/en/version3.x/pipeline_usage/table_recognition_v2.html#2-quick-start).
## Links
[PaddleOCR Repo](https://github.com/paddlepaddle/paddleocr)
[PaddleOCR Documentation](https://paddlepaddle.github.io/PaddleOCR/latest/en/index.html)