boun-tabi-LMG / turkish-lm-tuner

Turkish LM Tuner
https://boun-tabi-lmg.github.io/turkish-lm-tuner/
MIT License
73 stars 6 forks source link

Comparison with larger mT5 #44

Open gokceuludogan opened 5 months ago

gokceuludogan commented 5 months ago

Two larger mT5 models are available: mT5-XL, which has 3.7B parameters, and mT5-XXL, with 13B parameters.

We could experiment with mT5-XL. However, i am not certain whether mT5-XXL is feasible given our current resources.