How to support qwen2.5-7b-instruction ?

sophgo / LLM-TPU

Run generative AI models in sophgo BM1684X

Other

124 stars 19 forks source link

How to support qwen2.5-7b-instruction ? #49

Open wuhuzi opened 1 month ago

wuhuzi commented 1 month ago

I have fine-tuned the qwen2.5-7b-instruction model using Llama Factory, and now I need to deploy the fine-tuned qwen2.5 model on TPU.

How should I proceed with the support?

I have noticed that currently, only qwen2 is supported, and there is no support for qwen2.5 yet. Is there a significant difference between the two? When will the qwen2.5 series models be supported?

Hope to receive a reply.

Thanks.

baifengbai commented 3 weeks ago

take this url , https://github.com/sophgo/LLM-TPU/tree/main/models/Qwen2_5/compile