Thank you very much for this great app. Tried to pull gguf form HF but failed to do that.

WilliamKarolDiCioccio / open_local_ui

OpenLocalUI: Native desktop app for Windows, MacOS and Linux. Easily run Large Language Models locally, no complex setups required. Inspired by OpenWebUI's simplicity for LLM use.

MIT License

16 stars 2 forks source link

Thank you very much for this great app. Tried to pull gguf form HF but failed to do that. #37

Closed JohnClaw closed 3 weeks ago

JohnClaw commented 3 weeks ago

I tried to download this gguf: https://huggingface.co/NikolayKozloff/SambaLingo-Serbian-Chat-GGUF Unfortunately, Open Local UI can't do that for some reason. It displays this dialog for eternity: What am i doing wrong? How can i fix that? Help me, please.

github-actions[bot] commented 3 weeks ago

Hello and welcome to the OpenLocalUI repository!

Thank you for your interest in contributing to our project. To get started, please review the following resources:

Code of Conduct: Understand our expectations for a welcoming and inclusive environment.
Contributing Guidelines: Find detailed instructions on our development process, how to propose changes, and best practices to follow.
MIT License: Review our permissive license that encourages community contributions.

We appreciate your contributions and look forward to collaborating with you!

Best regards, The OpenLocalUI Team

JohnClaw commented 3 weeks ago

Oh, just read that it requires ollama. Closing the issue.

WilliamKarolDiCioccio commented 3 weeks ago

Hello @JohnClaw! Nice to get your feedback.

In the future Ollama will be automatically installed by the setup wizard, for now you'll have to do that manually. However I did a quick search in the Ollama models library listing available models to pull and the one you mentioned is not on the list. If you want to add a model from a GUFF file you should refer to this page. You can still do that from inside the app (never tested), I think you'd need to place the GUFF in the app directory, omit the base model in the create dialog and reference the the download one in the modelfile (FROM ./NikolayKozloff/SambaLingo-Serbian-Chat-GGUF).

Taking note of that. I'll open a new issue to add the feature

WilliamKarolDiCioccio commented 2 weeks ago

Hello, @JohnClaw! I've added the feature #38 you needed, hope this makes the process easier :)

JohnClaw commented 2 weeks ago

Hello, @JohnClaw! I've added the feature #38 you needed, hope this makes the process easier :)

Thanks. Please, compile the binary for Windows.

WilliamKarolDiCioccio commented 2 weeks ago

It's a matter of a pair of days or less. We just wanted to fix the remaining bugs