search

Wladastic / mini_autogpt

🤖 Mini-AutoGPT: A compact, Telegram-connected AI demonstrating the capabilities of local LLMs. Autonomous and experimental Proof of Concept
25 stars 6 forks source link

add model #2

Open ketsapiwiq opened 2 months ago

ketsapiwiq commented 2 months ago

With Ollama you need to specify the model

Wladastic commented 2 months ago

I would rather request the available models if not set and use the one returned as most API's give you only the one that is loaded. But I do not have experience with Ollama, I use LMstudio, TextGen and custom API. Does Ollama Support Model retrieval via api?

ketsapiwiq commented 2 months ago

Yes! See: https://github.com/ollama/ollama/blob/main/docs/api.md#list-local-models

Wladastic commented 2 months ago

But this returns multiple models at ones which are available. Does that mean they are currently running or just "exist" locally on the server?