ggerganov / ggml

Tensor library for machine learning
MIT License
11.22k stars 1.04k forks source link

example MPT quantization doesn't work #360

Open havietisov opened 1 year ago

havietisov commented 1 year ago

Followed this guide : https://github.com/ggerganov/ggml/tree/master/examples/mpt When tried to cast model to fp-16, got following error :

Maybe guide/code should be updated

klosax commented 1 year ago

_pickle.UnpicklingError: invalid load key, 'v'.

It looks like your model files are corrupted. Try download them again.