search

guinmoon / LLMFarm

llama and other large language models on iOS and MacOS offline using GGML library.
https://llmfarm.site
MIT License
1.06k stars 64 forks source link

Crash when running on my iPhone 14 pro max #3

Closed realcarlos closed 11 months ago

realcarlos commented 11 months ago

I am using this model "ggml-model-gpt-2-117M.bin", it runs well on Mac.

But crash on iPhone

2023-07-19 18:09:20.556462+0800 LLMFarm[8938:1493311] [DocumentManager] The view service did terminate with error: Error Domain=_UIViewServiceErrorDomain Code=1 "(null)" UserInfo={Terminated=disconnect method} ggml-model-gpt-2-117M_1689761363.json

reload

AI init gpt_neox_model_load: loading model from '/var/mobile/Containers/Data/Application/0B2FC557-3AEA-4E95-8FC5-667C71221240/Documents/models/ggml-model-gpt-2-117M.bin' - please wait ... gpt_neox_model_load: n_vocab = 50257 gpt_neox_model_load: n_ctx = 1024 gpt_neox_model_load: n_embd = 768 gpt_neox_model_load: n_head = 12 gpt_neox_model_load: n_layer = 12 gpt_neox_model_load: n_rot = 1 gpt_neox_model_load: par_res = 50257 gpt_neox_model_load: model_size = UNKNOWN gpt_neox_model_load: ftype = 1 gpt_neox_model_load: qntvr = 0 2023-07-19 18:09:29.353317+0800 LLMFarm[8938:1493518] [ServicesDaemonManager] interruptionHandler is called. -[FontServicesDaemonManager connection]_block_invoke 2023-07-19 18:09:29.354747+0800 LLMFarm[8938:1493518] [xpc] <PKDaemonClient: 0x2834fdcc0>: XPC error talking to pkd: Connection interrupted

guinmoon commented 11 months ago

you need to set gpt2 inference instead gpt_neox

realcarlos commented 11 months ago

you need to set gpt2 inference instead gpt_neox

Ok, my fault , it works now . Very great project ,and I am looking forward to the RWKV support.

guinmoon commented 11 months ago

you need to set gpt2 inference instead gpt_neox

Ok, my fault , it works now . Very great project ,and I am looking forward to the RWKV support.

added.