Switch to PyTorch as the main implementation - Githubissues

lopuhin / transformer-lm

Transformer language model (GPT-2) with sentencepiece tokenizer

164 stars 47 forks source link

Switch to PyTorch as the main implementation #4

Closed lopuhin closed 5 years ago

lopuhin commented 5 years ago

This supports multi-GPU pytorch training.

Missing features compared to TF:

validation
sample generation
lr finder