googlecolab / colabtools

Python libraries for Google Colaboratory
Apache License 2.0
2.2k stars 722 forks source link

Add NVIDIA H100 support #2694

Open GitHub30 opened 2 years ago

GitHub30 commented 2 years ago

Is your feature request related to a problem? Please describe. I'm always frustrated when training transfomer takes a long time.

Describe the solution you'd like Add NVIDIA H100 to accelerate training with Transformer Engine.

cperry-goog commented 2 years ago

Thanks for the request, in the meantime you can always explore our GCP Marketplace offering and look into acquiring H100s there: https://research.google.com/colaboratory/marketplace.html

faruknane commented 2 years ago

Yes, it would be really great for the community to develop faster with high end GPU cards @cperry-goog