search

cvlab-columbia / viper

Code for the paper "ViperGPT: Visual Inference via Python Execution for Reasoning"
Other
1.63k stars 117 forks source link

Recommended vram/reliable method to run CPU only? #3

Closed stevebottos closed 1 year ago

stevebottos commented 1 year ago

Just wondering how much vram you guys recommend. My GPU has 16gb but that doesn't seem to be enough as I'm running into OOM errors. Alternatively, is there a reliable method to run CPU-only? I've tried forcing the device in vision_models.py, line 36, but it looks that doesn't cover everything.

stevebottos commented 1 year ago

Fixed by using half precision and xl blip rather than xxl.