Shivanandroy / simpleT5

simpleT5 is built on top of PyTorch-lightning⚡️ and Transformers🤗 that lets you quickly train your T5 models.
MIT License
386 stars 62 forks source link

codet5 support added #17

Closed mosh98 closed 2 years ago

mosh98 commented 3 years ago

Needed to use this package for my experiemnts,

Salesforce/codet5-base uses a roberta tokenizer hence this pull request.

users can now specify : model.from_pretrained("codet5","Salesforce/codet5-base")

If you want to read through codet5

Here are the links: https://huggingface.co/Salesforce/codet5-base

Kind regards, Mosh

mosh98 commented 2 years ago

Hi, is there any problems with this pull requests?

eliasws commented 2 years ago

@Shivanandroy push

Shivanandroy commented 2 years ago

@mosh98 , @eliasws Apologies, I couldn't have a look at the PR as I was not actively managing this project. If it still needed, please raise a fresh PR as the main branch has new changes.

Closing it.