guinmoon / LLMFarm

llama and other large language models on iOS and MacOS offline using GGML library.
https://llmfarm.site
MIT License
1.05k stars 62 forks source link

The latest code simulator crash #36

Closed buhe closed 5 months ago

buhe commented 5 months ago

Nice project.

Env

iphone 15 iOS 17.0 M1 max xcode Version 15.2 (15C500b)

Log

log.txt

buhe commented 5 months ago

Enabled metal has crashed.

buhe commented 5 months ago

Testflight version is work with metal.

guinmoon commented 5 months ago

to run on the simulator you need to turn off the metal, later I will write a check for this in the code.

buhe commented 5 months ago

But i use real device: iphone 12

guinmoon commented 5 months ago

Hi I had a similar problem on my iphone 12 pro. Apparently the app crashed because the debugging information also takes up some memory space. Try to use a smaller model and read this article.

buhe commented 5 months ago

Thanks.