How to run IndicTrans2 using TPU's?

AI4Bharat / IndicTrans2

Translation models for 22 scheduled languages of India

https://ai4bharat.iitm.ac.in/indic-trans2

MIT License

214 stars 59 forks source link

How to run IndicTrans2 using TPU's? #46

Closed kathir-ks closed 6 months ago

kathir-ks commented 6 months ago

Is it possible to run IndicTrans2 using google cloud tpus?

jaygala24 commented 6 months ago

Hey @kathir-ks

Our team has released the flax port for IndicTrans2 en-indic 200M distilled model in the setu-translate repository. We will also be releasing the flax ports for the other models in the coming month. You can follow the instructions from the aforementioned repository for inference on TPUs. Thank you!

kathir-ks commented 6 months ago

Thank you