Training on TPU for StyleGan2

mit-han-lab / data-efficient-gans

[NeurIPS 2020] Differentiable Augmentation for Data-Efficient GAN Training

https://arxiv.org/abs/2006.10738

BSD 2-Clause "Simplified" License

1.27k stars 175 forks source link

Training on TPU for StyleGan2 #31

Closed sarmientoj24 closed 3 years ago

sarmientoj24 commented 3 years ago

Is it possible to use TPU from Google Colab to train using StyleGan2?

zsyzzsoft commented 3 years ago

It may be possible but currently we're not planning to implement it.

gwern commented 3 years ago

@sarmientoj24 If you want to train StyleGAN2 on TPUs, you can look into codebases that support it like shawwn's TPU fork: https://github.com/shawwn/stylegan2/tree/working This doesn't have ADA specifically. (Sid was working on them and got most of the way but I think ran into TPU problems.) If you really need ADA, doesn't Colab provide GPUs as well as TPUs? So you can run the original StyleGAN2-ADA code, I think.