search

erfanzar / EasyDeL

Accelerate your training with this open-source library. Optimize performance with streamlined training and serving options with JAX. 🚀
https://easydel.readthedocs.io/en/latest/
Apache License 2.0
167 stars 19 forks source link

Mixtral 8x7B support? #81

Closed clintg6 closed 5 months ago

clintg6 commented 5 months ago

Hi Erfan, I tried testing the Mixtral module and it failed returning "Returning Empty Params". Is this module working?

erfanzar commented 5 months ago

Hello due to not being able to evaluate the model params mixtral model can not be traced and that's a jax issue but if you load the model from torch or easy state you can ignore that cause model is loaded and you can use that.