clovaai / donut

Official Implementation of OCR-free Document Understanding Transformer (Donut) and Synthetic Document Generator (SynthDoG), ECCV 2022
https://arxiv.org/abs/2111.15664
MIT License
5.52k stars 443 forks source link

Can donut support batch inference? #262

Closed sjtu-cz closed 8 months ago

sjtu-cz commented 8 months ago

Can donut support batch inference?

CheungZeeCn commented 8 months ago

Why not? However, It's better to keep your batch prompt in the same length when inferring.

sjtu-cz commented 8 months ago

Why not? However, It's better to keep your batch prompt in the same length when inferring.

thanks