search

vietai / ViT5

MIT License
59 stars 9 forks source link

Convert checkpoint to HuggingFace #12

Open Lekja00160612 opened 1 year ago

Lekja00160612 commented 1 year ago

Hi team, I dive into the source code and make a guess that ViT5 was trained using t5x lib. I could not see the code to convert from jax code to huggingface compatible format. Can you open-source the code or give out some guidance? Thank you in advance.

justinphan3110 commented 1 year ago

Hi sorry for the late reply, Maybe a trace to this HuggingFace's implementation is a good starting point, let me know if it not working https://github.com/huggingface/transformers/pull/16853