search

QwenLM / qwen.cpp

C++ implementation of Qwen-LM
Other
514 stars 42 forks source link

C++ Version of Qwen-VL? #6

Open qnguyen3 opened 10 months ago

qnguyen3 commented 10 months ago

Are we going to get GGML/GGUF version of Qwen-VL?

DungMinhDao commented 10 months ago

Same question here

simonJJJ commented 10 months ago

It's not the top priority, but we would do that.

papasanimohansrinivas commented 8 months ago

please make it the priority @simonJJJ

papasanimohansrinivas commented 8 months ago

@simonJJJ can you tell us otherwise how to increase throughput on qwen-vl-chat-int4 any optmization techniques please

iHaagcom commented 5 months ago

I’m also interested