Closed sjtu-cz closed 8 months ago
Can donut support batch inference?
Why not? However, It's better to keep your batch prompt in the same length when inferring.
thanks
Can donut support batch inference?