Open maziyarpanahi opened 3 weeks ago
Thanks for reporting this @maziyarpanahi 👍
We don't have at the moment a lot of extra bandwidth but we might prioritize adding this model.
Also as a note, to indicate more demand for a model getting thumbs ups or similar reactions on your issue is a signal for us to prioritize something :)
Feature request
Add support for microsoft/Phi-3.5-MoE-instruct which has
PhiMoEForCausalLM
arch.Motivation
It fails with the following error:
Your contribution
I can test any PR