New GPT 774M model + TPU

rish-16 / gpt2client

✍🏻 gpt2-client: Easy-to-use TensorFlow Wrapper for GPT-2 117M, 345M, 774M, and 1.5B Transformer Models 🤖 📝

MIT License

372 stars 74 forks source link

New GPT 774M model + TPU #9

Closed marcoaleixo closed 4 years ago

marcoaleixo commented 5 years ago

They released a new model - https://openai.com/blog/gpt-2-6-month-follow-up/ And I think we will need TPU to use that model. I'm trying to use the 345M with TPU using Colab, but when I change to TPU the code uses CPU.

rish-16 commented 5 years ago

Hey there, thanks for the issue. I'll look into bringing the 774M model onboard. Will keep you updated.

Cheers

rish-16 commented 4 years ago

Hello there! gpt2-client is now compatible with the 774M model! Thank you so much for waiting :)