guinmoon / LLMFarm

llama and other large language models on iOS and MacOS offline using GGML library.
https://llmfarm.site
MIT License
1.05k stars 62 forks source link

Few feature requests.. #46

Closed ProCreations-Offical closed 3 months ago

ProCreations-Offical commented 4 months ago

Firstly, I’d love to see the ability to save the downloaded LLM’s to be saved on external drives. I tried to download an AI on my SSD but, when I loaded onto LLM Farm, it copied the file and placed it into On My iPhone >> LLM Farm >> Models. (In other words, I want it so I get to choose where the LLM is downloaded and saved instead of being fixed to LLM Farm >> Models). Secondly, I would love to see iOS Siri Shortcuts integration. Lastly, I couldn’t seem to get the Qwen AI model to work. No matter how hard I tried and how much I looked, it kept giving errors.

ProCreations-Offical commented 3 months ago

@guinmoon

guinmoon commented 3 months ago

Maybe someday I'll realize it all. The Qwen models have been discussed here.

ProCreations-Offical commented 3 months ago

Maybe someday I'll realize it all. The Qwen models have been discussed here.

Thanks for the reply! I’ll take a look at the qwen thing.