Bert tokenizer - Githubissues

jerpint / jag

MIT License

1 stars 0 forks source link

Bert tokenizer #26

Closed jerpint closed 5 years ago

jerpint commented 5 years ago

Add bert tokenizer with its associated unit tests.

The bert tokenizer was taken from Hugging Face

Closes #25