Is Qwen in the roadmap?

pytorch / executorch

On-device AI across mobile, embedded and edge for PyTorch

https://pytorch.org/executorch/

Other

1.35k stars 218 forks source link

Is Qwen in the roadmap? #3583

Open DzAvril opened 3 weeks ago

DzAvril commented 3 weeks ago

Hello executorch team,

I have a question regarding the compatibility of executorch with Qwen, an open-source llm created by Alibaba Group (QWen) . Are there any plans to support Qwen in the future?

Thank you for your attention.

mikekgfb commented 2 weeks ago

I have not looked at Qwen in detail, but if the architecture is similar to llama2 or llama3 it should be very easy to add, by writing a parameter json file for the model. (The MoE part may require some work?)

ExecuTorch is an OSS project and we're excited to take community contributions that meet our open source commitments and coding standards! So, if you're interested in exploring how to add support for Qwen, we'll be delighted to get a submission!

DzAvril commented 2 weeks ago

Thanks for your response @mikekgfb . In the v0.2 release note, I noticed that QW1.5 7B has been tested using torch.export. Would it be possible for you to share the test code as a reference for supporting QWen with executorch?

JacobSzwejbka commented 2 weeks ago

@cbilgin were you involved in that testing suite

DzAvril commented 5 days ago

I apologize for reaching out once again, but would it be possible for someone to kindly provide some guidelines on how to support QWen?