Closed onlyonewater closed 1 year ago
hi, authors, great work, when I used your code to train the model in the DDP form, the memory of each GPU was different, so how do I fix the code to let each GPU have the same memory when using DDP to train the model?
hi, authors, great work, when I used your code to train the model in the DDP form, the memory of each GPU was different, so how do I fix the code to let each GPU have the same memory when using DDP to train the model?