Closed hypnopump closed 11 months ago
Currently batch size will affect the order of samples, therefore can't adjust the effective batch_size (num_gpus * batch_size * update_freq) and keep the same results.
num_gpus * batch_size * update_freq
See for context: https://github.com/dptech-corp/Uni-Core/pull/39
Currently batch size will affect the order of samples, therefore can't adjust the effective batch_size (
num_gpus * batch_size * update_freq
) and keep the same results.See for context: https://github.com/dptech-corp/Uni-Core/pull/39