Update Transformers to 4.6.1

deepset-ai / FARM

:house_with_garden: Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.

https://farm.deepset.ai

Apache License 2.0

1.73k stars 247 forks source link

Update Transformers to 4.6.1 #787

Closed julian-risch closed 3 years ago

julian-risch commented 3 years ago

[x] Run tests
[x] Run benchmark

closes #786

Timoeller commented 3 years ago

I like unpinning the Transformers version but it might create strange behavior. E.g. some models/fast tokenizers (e.g. for BigBird) are just available in 4.5.0++ and we do not rigorously test for all model + tokenizer cases in combination with our tasks.

If we unpin the version we will first need to invest some time for extensive tests and a CI that checks for all (minor) versions.