guinmoon / LLMFarm

llama and other large language models on iOS and MacOS offline using GGML library.
https://llmfarm.site
MIT License
1.05k stars 62 forks source link

Add list of downloadable models to the app #32

Closed verhovsky closed 4 months ago

verhovsky commented 5 months ago

When I press "add model" it only lets me add one from a file.

It would be better if you had the list of models from the website in the app, because I originally thought I was supposed to go to huggingface and figure out which models can run on my device myself, which is a lot of work since I want to run the best model... and each experiment involves downloading a 3GB+ file.

You should keep the Q/K values from TheBloke's file names in the model name so that I can know which model quantization levels my phone is capable of running.