search

go-skynet / go-ggml-transformers.cpp

Binding to transformers in ggml
MIT License
58 stars 11 forks source link

falcon model? #36

Open alienatorZ opened 1 year ago

alienatorZ commented 1 year ago

Does this support falcon 40b? I am trying with this model: https://huggingface.co/TheBloke/falcon-40b-instruct-GGML/blob/main/falcon-40b-instruct.ggccv1.q4_0.bin and I am getting the error:

falcon_model_load: invalid model file '.../Downloads/falcon-40b-instruct.ggccv1.q4_0.bin' (bad magic) falcon_bootstrap: failed to load model from '.../Downloads/falcon-40b-instruct.ggccv1.q4_0.bin'