search

assafelovic / gpt-researcher

LLM based autonomous agent that does online comprehensive research on any given topic
https://gptr.dev
Apache License 2.0
14.25k stars 1.86k forks source link

Changing ollama base url #566

Closed ahhany closed 3 months ago

ahhany commented 4 months ago

When you set any base url, the app adds "/api/chat" after the base URL, which will make it impossible to use something like lmstudio or any fixed LLM provider. Is there a solution for this?

sebaxzero commented 3 months ago

ollama base url its meant to use with ollama, for lm-studio you can use LLM_PROVIDER="openai" and EMBEDDING_PROVIDER="custom"

docs

.env example:

LLM_PROVIDER="openai"
EMBEDDING_PROVIDER="custom"
OPENAI_BASE_URL="http://localhost:1234/v1"
OPENAI_API_KEY="Local"