Open yichaoshen-MS opened 11 months ago
What are the settings of the num_gpus and batchsize_per_gpu? And what is the total gpu number? Is support gradient_accumulation_steps?
What are the settings of the num_gpus and batchsize_per_gpu? And what is the total gpu number? Is support gradient_accumulation_steps?