Closed maoyunyao closed 1 year ago
Hello, how many GPUs do you use for pre-training? I tried to use 4 x RTX3090, but out of memory.
Hi. Thanks for visiting. I'm using 3x 40GB gpus for pretraining and linear evaluation. Please change the batch size for the lower memory.
Hello, how many GPUs do you use for pre-training? I tried to use 4 x RTX3090, but out of memory.