search

PetrochukM / PyTorch-NLP

Basic Utilities for PyTorch Natural Language Processing (NLP)
https://pytorchnlp.readthedocs.io
BSD 3-Clause "New" or "Revised" License
2.21k stars 258 forks source link

Could pre-training BERT or multi-head self-attention be added? #80

Closed ghost closed 5 years ago

PetrochukM commented 5 years ago

Please add this if you have the time; otherwise, I don't have the time.