search

turboderp / exui

Web UI for ExLlamaV2
MIT License
426 stars 41 forks source link

gguf models #56

Open DjagbleyEmmanuel opened 3 months ago

DjagbleyEmmanuel commented 3 months ago

Does it support gguf models on hugging face?

turboderp commented 3 months ago

It doesn't, no. It's specifically a frontend for ExLlamaV2, which works with EXL2, GPTQ and unquantized models.

DjagbleyEmmanuel commented 3 months ago

okay thanks!