Closed the-crypt-keeper closed 8 months ago
New GGUF models:
https://huggingface.co/maddes8cht/tiiuae-falcon-40b-instruct-gguf
https://huggingface.co/maddes8cht/tiiuae-falcon-7b-instruct-gguf
Looks like k-quants aren't supported
Completed.
New GGUF models:
https://huggingface.co/maddes8cht/tiiuae-falcon-40b-instruct-gguf
https://huggingface.co/maddes8cht/tiiuae-falcon-7b-instruct-gguf
Looks like k-quants aren't supported