search

alexrozanski / LlamaChat

Chat with your favourite LLaMA models in a native macOS app
https://llamachat.app
MIT License
1.43k stars 53 forks source link

Support downloadable models #6

Open umaar opened 1 year ago

umaar commented 1 year ago

Any chance we could just select the model, and then LlamaChat downloads the necessary files automatically?

matthieu-lapeyre commented 1 year ago

+1 I have currently downloaded 20GB+ of models, none is working -_-'

alexrozanski commented 1 year ago

@umaar Definitely been thinking about this for the publicly available models. This won't be happening for most though because of their distribution terms 👎

@matthieu-lapeyre If there are specific problems could you open another Issue? I wonder if maybe your problems are related to #3 — I have some ideas for this in the works!

umaar commented 1 year ago

That's fair, how about a middle ground - include a direct download link to the model file, or if it's required we accept some terms, direct link to the model landing page?

alexrozanski commented 1 year ago

yeah, I think at least for GPT4All which publish a direct download link this will work!

mignochrono commented 1 year ago

That's fair, how about a middle ground - include a direct download link to the model file, or if it's required we accept some terms, direct link to the model landing page?

maybe adding some more information on the Readme page, like where to download, what to download, and how to set up the environment to deploy the app. with sections for each one of the supported models(maybe some links).

alexrozanski commented 1 year ago

@mignochrono there are some links already in-app but agreed that these could be improved. I think it would be better to improve the UI here because the plan is to add more models, which could get unwieldy if they're all documented in the README.

how to set up the environment to deploy the app

What do you mean by this exactly? Building from source, or something else?

JulianBissekkou commented 3 months ago

Can someone post a short instruction on how to downlaod and install a model that worked for them? I also had problems getting it working and this would be nice.

Having a quickstart guide on how to get your first chat running would be nice