Open muellerdo opened 1 year ago
https://towardsdatascience.com/a-batch-too-large-finding-the-batch-size-that-fits-on-gpus-aef70902a9f1
Max batch size= available GPU memory bytes / 4 / (size of tensors + trainable parameters) https://stackoverflow.com/questions/46654424/how-to-calculate-optimal-batch-size
https://proceedings.mlr.press/v97/agarwal19a/agarwal19a.pdf
https://towardsdatascience.com/a-batch-too-large-finding-the-batch-size-that-fits-on-gpus-aef70902a9f1
Max batch size= available GPU memory bytes / 4 / (size of tensors + trainable parameters) https://stackoverflow.com/questions/46654424/how-to-calculate-optimal-batch-size
https://proceedings.mlr.press/v97/agarwal19a/agarwal19a.pdf