search

0cc4m / KoboldAI

GNU Affero General Public License v3.0
150 stars 31 forks source link

"expected scalar type BFloat16 but found Half" #58

Open j2l opened 1 year ago

j2l commented 1 year ago

Tried your fork to run your model https://huggingface.co/OccamRazor/mpt-7b-storywriter-4bit-128g/

Using it locally, this model throws the error expected scalar type BFloat16 but found Half image

IDK what to do to fix this. Would you please let me know if it works for you or how to fix this? Attached is debug and config.json: debug.zip

Thanks