search

hszhao / SAN

Exploring Self-attention for Image Recognition, CVPR2020.
MIT License
747 stars 133 forks source link

about the minimum GPU memory required #1

Closed amiltonwong closed 4 years ago

amiltonwong commented 4 years ago

Hi, @hszhao ,

Thanks for releasing the package. I'd rather to know the minimum requirement on GPU memory. Is a GPU with 12GB enough to run the training?

THX!

hszhao commented 4 years ago

Hi, our experiments on ImageNet (crop size as 224x224, batch size as 256) are conducted on a server with 8 x Quadro RTX 6000 (24G). Detailed memory usage for each GPU is listed below: Pairwise-SAN10/15/19: 13091/17259/20781MiB. Patchwise-SAN10/15/19: 9007/11479/13493MiB.