Defer to llama.cpp for prompt templating

psugihara / FreeChat

llama.cpp based AI chat app for macOS

https://www.freechat.run

MIT License

402 stars 34 forks source link

Defer to llama.cpp for prompt templating #63

Closed psugihara closed 2 months ago

psugihara commented 2 months ago

I believe llama.cpp can now handle this for us by looking at the GGUF. It would be great to get rid of the hardcoded prompt templates in this repo and UI.