Closed Alex-HaochenLi closed 9 months ago
hello, in your original codes, there is no argument for receiving world_size. However, in the function of _reduceloss, we need world_size as a parameter , and this need to be received by argument parser.
hello, in your original codes, there is no argument for receiving world_size. However, in the function of _reduceloss, we need world_size as a parameter , and this need to be received by argument parser.