search

yizhongw / Tk-Instruct

Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
https://arxiv.org/abs/2204.07705
MIT License
177 stars 27 forks source link

Request for checkpoints of smaller models #1

Closed itayle closed 2 years ago

itayle commented 2 years ago

Hi, Really loved your work! Thanks for sharing your 3B and 11B checkpoints. Would it be possible to upload the checkpoints for small models as well? (small, base and large sizes)

yizhongw commented 2 years ago

Hi @itayle I have uploaded the smaller models. Now you can find all the released models here.

I also want to note that I found a remarkable gap between the smaller models and the 11B or 3B models in generalizing to new tasks. Let me know if you have any interesting findings in playing with them :)

itayle commented 2 years ago

Thanks a lot! Sure, I'll let you know :)