App crashes when running fine tune on Llama-3

guinmoon / LLMFarm

llama and other large language models on iOS and MacOS offline using GGML library.

https://llmfarm.site

MIT License

1.05k stars 62 forks source link

Closed kebbbnnn closed 1 month ago

kebbbnnn commented 1 month ago

App crashes when I run fine tune on Llama-3 model but works perfectly when I try on tinyllama:

Thread 16: EXC_BAD_ACCESS (code=2, address=0x16b5a7c40)

Screenshot 2024-05-17 at 11 25 02 AM

Screenshot 2024-05-17 at 11 26 21 AM

info of my machine:

mac: mac mini m1 2020 ram: 8GB os: ventura 13.6 Xcode: Xcode 15.1

guinmoon commented 1 month ago

I think it has to do with lack of memory. Llama3 is too big for finetune on your Mac. Try openllama 3b.