search

openvino-dev-samples / chatglm3.openvino

This sample shows how to deploy ChatGLM3 using OpenVINO
17 stars 5 forks source link

MoE model surport #5

Closed beingjoey closed 4 months ago

beingjoey commented 5 months ago

when could openvino convert MoE model, like Qwen1.5-MoE-2.7B ?

openvino-dev-samples commented 5 months ago

Maybe you can try this repository: https://github.com/OpenVINO-dev-contest/Qwen2.openvino