[FEATURE] add support for GGUF models

liltom-eth / llama2-webui

Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere (Linux/Windows/Mac). Use `llama2-wrapper` as your local llama2 backend for Generative Agents/Apps.

MIT License

1.96k stars 201 forks source link

[FEATURE] add support for GGUF models #73

Closed liltom-eth closed 1 year ago