search

the-crypt-keeper / can-ai-code

Self-evaluating interview for AI coders
https://huggingface.co/spaces/mike-ravkine/can-ai-code-results
MIT License
513 stars 29 forks source link

Deprecate ggllm.cpp support and re-run GGML (GGCC) models with GGUF #131

Closed the-crypt-keeper closed 8 months ago

the-crypt-keeper commented 8 months ago

New GGUF models:

https://huggingface.co/maddes8cht/tiiuae-falcon-40b-instruct-gguf

https://huggingface.co/maddes8cht/tiiuae-falcon-7b-instruct-gguf

Looks like k-quants aren't supported

the-crypt-keeper commented 8 months ago

Completed.