search

go-skynet / go-llama.cpp

LLama.cpp golang bindings
MIT License
614 stars 78 forks source link

Build with >799a1cb13b0b1b560ab0ceff485caed68faa8f1f to support Mixtral #314

Open sfxworks opened 6 months ago

sfxworks commented 6 months ago

I believe, in order to resolve https://github.com/mudler/LocalAI/pull/1446, go-llama.cpp needs to be built against at least version 799a1cb13b0b1b560ab0ceff485caed68faa8f1f of llama.cpp to enable mixtral support

sfxworks commented 6 months ago

I believe the auto prs are related https://github.com/go-skynet/go-llama.cpp/pull/313

msuiche commented 5 months ago

Any update on this

allnash commented 3 months ago

@mudler how can we help get this in? I get an error building on Apple Metal with the current master and this llama.cpp commit 799a1cb13b0b1b560ab0ceff485caed68faa8f1f

Any advice?