Questions about GPU cards and GPU memory

tianrun-chen / SAM-Adapter-PyTorch

Adapting Meta AI's Segment Anything to Downstream Tasks with Adapters and Prompts

MIT License

1k stars 89 forks source link

Questions about GPU cards and GPU memory #71

Closed guokeqianhg closed 5 months ago

guokeqianhg commented 5 months ago

Hello, thanks for your great work！But I would like to ask how to run from a single GPU, and I wonder to know if it is possible to train with only 8GB GPU memory?

tianrun-chen commented 5 months ago

For our default setting, it may require ~60Gb of VRAM, so we suggest using A100 GPU to run the program due to the large VRAM cost of SAM. You can also try to use ViT-H or ViT-B version, which may be lower in accuracy but may be able to run for ~24 Gb of VRAM.