openclimatefix / skillful_nowcasting

Implementation of DeepMind's Deep Generative Model of Radar (DGMR) https://arxiv.org/abs/2104.00954
MIT License
211 stars 59 forks source link

how to train using multiple gpus? #58

Open PeeInTheWind opened 1 year ago

PeeInTheWind commented 1 year ago

hi, dear authors, thank you for sharing you cool model. i am trying to train the model on my datasets to figure it out how it works well. the problem is that although it can run with 1 gpu (A-100-unique), the gpu capactiy will soon be filled and the train goes very slowly. so i change to 2 gpus, but an error is reported and i cannot fix it. could you please give me some suggestions how to solve it ?

thanks a lot

image

peterdudfield commented 11 months ago

Could you give a bit more of the error message and what version of the packages you are running please?

rutkovskii commented 6 months ago

@PeeInTheWind Hi, did you get it to work?