search

reorproject / reor

Private & local AI personal knowledge management app for high entropy thinkers.
https://reorproject.org
GNU Affero General Public License v3.0
7.13k stars 439 forks source link

cannot connect to local remote llm #80

Closed leeyaunlong closed 8 months ago

leeyaunlong commented 8 months ago

I startup the local llm with JAN.AI. http://127.0.0.1:1337/v1/chat/completions model: openchat-3.5-7b

I follow the guide , test the api is work. https://github.com/oobabooga/text-generation-webui/wiki/12-%E2%80%90-OpenAI-API

But I apply it with reor 0.1.48. And try to ask the question , get the error: Error during OpenAI streaming session: Error: 404 "Not Found"

samlhuillier commented 8 months ago

Hello @leeyaunlong I've just tried using JAN and found that the api route you need to use is this: http://localhost:1337/v1/ Whatever comes before /chat/completions basically.

I'll update the docs with some guidance on this

leeyaunlong commented 8 months ago

Hello @leeyaunlong I've just tried using JAN and found that the api route you need to use is this: http://localhost:1337/v1/ Whatever comes before /chat/completions basically.

I'll update the docs with some guidance on this

Thanks, it's work well.