search

AI4Bharat / IndicTrans2

Translation models for 22 scheduled languages of India
https://ai4bharat.iitm.ac.in/indic-trans2
MIT License
214 stars 59 forks source link

Model Optimization #70

Closed pratik443 closed 3 months ago

pratik443 commented 3 months ago

Is there a way to optimize the overall model, for space, like we use quantization for LLM. is there any similar methods for Indictrans2?

PranjalChitale commented 3 months ago

Please check example.py.