search

guinmoon / LLMFarm

llama and other large language models on iOS and MacOS offline using GGML library.
https://llmfarm.site
MIT License
1.05k stars 62 forks source link

Apple Model Available #45

Closed lawyinking closed 3 months ago

lawyinking commented 4 months ago

Is anyone willing to list the Apple models and corresponding hardware details (e.g. RAM) that can run the listed LLM models using LLM Farm? If so that would be great.

Many thanks!

guinmoon commented 4 months ago

Hi, some tests of llama.cpp, which is the basis for LLMFarm, can be seen here.

lawyinking commented 4 months ago

Thank you so much!