Add distributed training scripts for ResNet50_bs128_fp32, ShuffleNetV2_x1_0_bs1536_fp32, MobileNetV3_large_x1_0_bs640_fp32 and SwinTransformer_tiny_patch4_window7_224_bs104_fp32. Now these benchmark can be tested on multi nodes. And fix bug of HRNet. When multi-process create the same folder, it may cause conflict.
Add distributed training scripts for ResNet50_bs128_fp32, ShuffleNetV2_x1_0_bs1536_fp32, MobileNetV3_large_x1_0_bs640_fp32 and SwinTransformer_tiny_patch4_window7_224_bs104_fp32. Now these benchmark can be tested on multi nodes. And fix bug of HRNet. When multi-process create the same folder, it may cause conflict.