utterworks / fast-bert

Super easy library for BERT based NLP models
Apache License 2.0
1.86k stars 341 forks source link

Is it possible to run with TPU on Colab? #168

Open leejason opened 4 years ago

leejason commented 4 years ago

It would be great if TPU is possible.

kaushaltrivedi commented 4 years ago

Not yet. Haven’t evaluated this yet but is on my radar.

kirilzilla commented 4 years ago

seems to be the same case even with Google Colab Pro and GPU activated?

Warning: multi_tensor_applier fused unscale kernel is unavailable, possibly because apex was installed without --cuda_ext --cpp_ext. Using Python fallback. Original ImportError was: ModuleNotFoundError("No module named 'amp_C'",)