search

RichardErkhov / quant_request

You can request more quants here
1 stars 0 forks source link

requesting phi3.5-moe (guff?) #2

Open PGTBoos opened 3 months ago

PGTBoos commented 3 months ago

Can you make Phi 3.5-MoE version available to software such as LM studio ? (by converting to guff or so?)

RichardErkhov commented 3 months ago

https://github.com/ggerganov/llama.cpp/issues/9119 waiting for this. When it will be merged, then I will be able to create GGUF. For now, can't offer a gguf now