Open LingyvKong opened 1 year ago
Hello, If I train a network with 2 gpus, the real batchsize is batch_sampler? or 2*batch_sampler? what about the learning rate?
Thank you
the total batchsize = batchsize * gpu_num @LingyvKong
Hello, If I train a network with 2 gpus, the real batchsize is batch_sampler? or 2*batch_sampler? what about the learning rate?
Thank you