search

Ki6an / fastT5

⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
Apache License 2.0
564 stars 72 forks source link

Explicit mt5 support #35

Closed sam-writer closed 2 years ago

sam-writer commented 2 years ago

We closed #20 but there is a possibility of errors when using T5ForConditionalGeneration with an mt5 model; this adds more explicit support for mt5 models.

It also removes some unused imports and bumps the version