UKPLab / EasyNMT

Easy to use, state-of-the-art Neural Machine Translation for 100+ languages
Apache License 2.0
1.16k stars 113 forks source link

AutoModel: added the possibility to set the max_length param of the tokenizer #75

Closed nateagr closed 2 years ago

nateagr commented 2 years ago

It is important to have the possibility to tune this parameter to avoid OOMs.

nreimers commented 2 years ago

Thanks for the PR :)