Open Godofnothing opened 1 year ago
In the example of deeplab training in the yaml config file deeplab/yamls/deeplabv3.yaml it is written in config file:
yaml
batch_size: 128 # Training dataloader batch size per device - line 26 batch_size: 128 # Evaluation dataloader batch size per device - line 39
But, according to the main.py (lines 64-66) it should be not the batch size per device rather the total batch size.
main.py
batch size per device
total batch size
if dist.get_world_size(): train_batch_size //= dist.get_world_size() eval_batch_size //= dist.get_world_size()
Yes, that comment is incorrect. batch_size is the total batch size not per device batch size. We will fix it ASAP, thank you for the notice!
batch_size
In the example of deeplab training in the
yaml
config file deeplab/yamls/deeplabv3.yaml it is written in config file:But, according to the
main.py
(lines 64-66) it should be not thebatch size per device
rather thetotal batch size
.