Closed goodmattg closed 4 years ago
Looks great, except in datasets/init.py your get_dataloaders function's argumentsare currently the config and num_workers - do you not think that should also be specified as part of the config file?
Sure I’ll change it to max_num_workers. Typically, you set the number of workers to the number of cores on your cpu/gpu.
I spoke too early; how to optimally set num_workers
is still up for debate, but the workers on CPU, which loads data and then sends to GPU with .to(device)
or cuda()
https://discuss.pytorch.org/t/guidelines-for-assigning-num-workers-to-dataloader/813/6
train.py
to use Ignite with simple logging callbackmake lint
to black format the code