How to estimate the required video memory?

clovaai / donut

Official Implementation of OCR-free Document Understanding Transformer (Donut) and Synthetic Document Generator (SynthDoG), ECCV 2022

https://arxiv.org/abs/2111.15664

MIT License

5.53k stars 444 forks source link

How to estimate the required video memory? #238

Closed chopin1998 closed 8 months ago

chopin1998 commented 11 months ago

when i adjust processor.image_processor.size from {'height': 960, 'width': 720} to higher, GPU said CUDA out of memory..

my Video Card 8GB video, i wanna know, if i wanna use {'height': 2560, 'width': 1920}, how much VRAM will be used? does 16GB ok ?

sudhitpanchal commented 9 months ago

More input size means more GPU, keep in mind that batch size and other parameters affect the same so as per your requirement 16 GB would be enough i guess what happened when you tried using 16GB?