search

cpllab / lm-zoo

Easy black-box access to state-of-the-art language models
https://cpllab.github.io/lm-zoo/
MIT License
14 stars 6 forks source link

transformer-xl tokenizer ignores punctuation #13

Closed hans closed 5 years ago

hans commented 5 years ago

e.g. sentence final: "This is a sentence." --> "This is a sentence."