I tested it and the speed is very slow. Can it be optimized? It seems that it cannot meet the online needs.

VikParuchuri / marker

Convert PDF to markdown quickly with high accuracy

https://www.datalab.to

GNU General Public License v3.0

14.65k stars 764 forks source link

Closed xuboot closed 2 months ago

xuboot commented 2 months ago

I tested it and the speed is very slow. Can it be optimized? It seems that it cannot meet the online needs.

VikParuchuri commented 2 months ago

To speed it up, you can:

Use tesseract instead of surya for OCR if you're on CPU (surya OCR is slow on CPU)
Use GPU
Parallelize with marker (use more workers)

I need to quant + compile the models, which will speed things up.

xuboot commented 2 months ago

@VikParuchuri "I need to quant + compile the models, which will speed things up" Will this version be released

VikParuchuri commented 2 months ago

Yes, hoping to get some time to do that