Has anyone gotten Mistral 7B Int4 working on iOS 18?

huggingface / swift-chat

Mac app to demonstrate swift-transformers

Apache License 2.0

491 stars 37 forks source link

Open eemilk opened 2 months ago

eemilk commented 2 months ago

I am trying to run Mistral 7B int4 on iPhone 15 Pro but getting this error Running with preview version. On mac works fine.