gguf models - Githubissues

turboderp / exui

Web UI for ExLlamaV2

MIT License

449 stars 43 forks source link

Open DjagbleyEmmanuel opened 5 months ago

DjagbleyEmmanuel commented 5 months ago

Does it support gguf models on hugging face?

turboderp commented 5 months ago

It doesn't, no. It's specifically a frontend for ExLlamaV2, which works with EXL2, GPTQ and unquantized models.

DjagbleyEmmanuel commented 5 months ago

okay thanks!