can use this to train gpt2 directly

asyml / texar-pytorch

Integrating the Best of TF into PyTorch, for Machine Learning, Natural Language Processing, and Text Generation. This is part of the CASL project: http://casl-project.ai/

https://asyml.io

Apache License 2.0

744 stars 118 forks source link

can use this to train gpt2 directly #305

Closed alphanlp closed 4 years ago

huzecong commented 4 years ago

The gpt2_train_main.py file in the GPT-2 example directory can be used to train a GPT-2 model from scratch, if that's what you're asking about. Please also be more specific about your question.

huzecong commented 4 years ago

Closing due to lack of activity and clarity.