Open gusanmaz opened 1 year ago
Hey @gusanmaz, did you get the information on the GPU requirements? Thanks.
yeah, they say you need at least 13 Gb of VRAM. Here's an excerpt from running ODISE on T4 GPU . 13.2 Gb
Hi! I can see that the Colab offers 15 GB of GPU RAM. But still whenever I run the colab code the instance crashes. Any workarounds on this?
@tejassp2002 Probably because during loading the model reaches more than 12 Gb of RAM for a brief moment of time (Colab has 12 Gb), and Google provides no SWAP to accommodate this. This is system RAM, not GPU RAM
I get
CUDA out of memory
error when I runpython demo/demo.py --input demo/examples/coco.jpg --output demo/coco_pred.jpg --vocab "black pickup truck, pickup truck; blue sky, sky"
on RTX 3060 GPU with 12GB of vram.Last lines of the error is as follows:
What are the minimum requirements for running inference code? Is there a way to prevent getting these errors on less powerful systems? Is it possible to perform inference using CPU?
Thanks!