[request]qwen1 not supported by vllm-xft

intel / xFasterTransformer

Apache License 2.0

270 stars 53 forks source link

Closed zhm-algo closed 2 weeks ago

zhm-algo commented 3 weeks ago

qwen1 not supported by vllm-xft @pujiang2018

pujiang2018 commented 3 weeks ago

@abenmao Could you please help to evaluate the effort?

abenmao commented 3 weeks ago

@abenmao Could you please help to evaluate the effort?

I will add this support asap.

Duyi-Wang commented 2 weeks ago

Release v1.7.2 supported. #449