search

bigscience-workshop / t-zero

Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)
Apache License 2.0
457 stars 53 forks source link

mesh tensorflow checkpoints? #25

Closed hamishivi closed 2 years ago

hamishivi commented 2 years ago

Hi, thanks for this great work! Are you able to share mesh tensorflow checkpoints of the t0 models? It looks like you trained the models originally using the t5 mesh tensorflow library, so having these original checkpoints would be really useful for working with t0 using t5x (which I am trying to do).

VictorSanh commented 2 years ago

I emailed you @hamishivi :)

ahmetustun commented 1 year ago

Hi, great work! I was also looking for mesh tensorflow checkpoints of the T0 models. Would you be able to share them with me as well?
I'd really appreciate it, thanks!