search

tsmaster / nanogenmo2019book

The source code for my National Novel Generation Month book
1 stars 0 forks source link

train gpt2 somehow? #24

Open tsmaster opened 4 years ago

tsmaster commented 4 years ago

Need to look into the docs for huggingface's pytorch-transformer library to see how to train it

then what to train it on? Gutenberg-dammit? that seems probably pretty good.

Or maybe just a subset of adventures - gulliver's travels, moby dick, cervantes?

tsmaster commented 4 years ago

https://github.com/huggingface/transformers/blob/master/examples/run_lm_finetuning.py