Purpose of gpu: None argument in config file is confusing. Users are confused whether it needs to be set to ALL gpuIDs for multi-GPU configuration. What None means and does in the context of multi-GPU setting.
Proposed ideas:
-> rename gpu to gpuID to make the purpose of the variable clearer.
-> Support specification of multiple gpuIDs (if only one index, run in single GPU mode, if more than one, it will be distributed but only using the gpu whose indices are provided through config) and a string "all" which then means a multi-GPU setting that uses ALL available GPUs.
-> Additionally, add detailed comments in the default config file to make the usage clear. Users may not want to run python main.py --help to understand the usage of each config option.
Purpose of gpu: None argument in config file is confusing. Users are confused whether it needs to be set to ALL gpuIDs for multi-GPU configuration. What None means and does in the context of multi-GPU setting.
Proposed ideas: -> rename
gpu
togpuID
to make the purpose of the variable clearer. -> Support specification of multiple gpuIDs (if only one index, run in single GPU mode, if more than one, it will be distributed but only using the gpu whose indices are provided through config) and a string "all" which then means a multi-GPU setting that uses ALL available GPUs. -> Additionally, add detailed comments in the default config file to make the usage clear. Users may not want to runpython main.py --help
to understand the usage of each config option.