pytorch versions of models for TPUs?

tensorflow / tpu

Reference models and tools for Cloud TPUs.

https://cloud.google.com/tpu/

Apache License 2.0

5.21k stars 1.77k forks source link

pytorch versions of models for TPUs? #369

Closed den-run-ai closed 5 years ago

den-run-ai commented 5 years ago

Last year Google announced support for TPUs in Pytorch. Do you have any reference models yet? Particularly interested in the distributed models presented at Google I/O 2019 for TF/Keras.

https://cloud.google.com/blog/products/ai-machine-learning/introducing-pytorch-across-google-cloud

https://cloud.google.com/blog/products/ai-machine-learning/googles-scalable-supercomputers-for-machine-learning-cloud-tpu-pods-are-now-publicly-available-in-beta

jysohn23 commented 5 years ago

PyTorch support for TPUs is under active development and you can check out the current progress in the pytorch/xla repository along with currently working models under test/. We plan to have all future models there too.