search

erfanzar / EasyDeL

Accelerate your training with this open-source library. Optimize performance with streamlined training and serving options with JAX. 🚀
https://easydel.readthedocs.io/en/latest/
Apache License 2.0
168 stars 19 forks source link

lora finetuning? #3

Closed Cyclcrclicly closed 12 months ago

Cyclcrclicly commented 1 year ago

awesome repo! any plans for lora finetuning support?

erfanzar commented 1 year ago

thanks ! yes for sure for now I'm planning to support all the models (Bert and T5) but after that ill go for Lora and QLora

Cyclcrclicly commented 1 year ago

awesome! thank you 🙏