njallskarp / finetune-qa-powerset

Finetuning BERT models on a powerset of different linguistic domains
https://lvl.ru.is/
5 stars 0 forks source link

Added tokenizers package to dependencies #29

Closed lsig closed 1 year ago

lsig commented 1 year ago

Added Tokenizers dependencies to pyproject.toml

In this PR I added the tokenizers dependecy to our pyproject.toml, which was missing

How to test