search

cmp-nct / ggllm.cpp

Falcon LLM ggml framework with CPU and GPU support
Other
244 stars 21 forks source link

Would ggllm.cpp adopt the upcoming ggml fileformat (GGUF)? #72

Open klosax opened 1 year ago

klosax commented 1 year ago

@cmp-nct

PR here: https://github.com/ggerganov/ggml/pull/302

cmp-nct commented 1 year ago

I've reopened it, currently there is no real benefit from switching to it, just a lot of work. In the long run it's likely the better choice.