DannyMerkx / next_word_prediction

Pytorch implementation of next word prediction. Includes my own implementation of Google AI's Transformer architecture
26 stars 13 forks source link

Project aimed at comparing Transformers and RNNs as models of human sentence processing.

Please cite our CMCL paper if you use this work:

@inproceedings{Merkx2021HumanSP, title={Human Sentence Processing: Recurrence or Attention?}, author={Danny Merkx and S. Frank}, booktitle={CMCL}, year={2021} }