sugarforever / chat-ollama

ChatOllama is an open source chatbot based on LLMs. It supports a wide range of language models, and knowledge base management.
MIT License
2.67k stars 416 forks source link

Does chat-ollama have timeout when requesting ollama #224

Open wgong opened 7 months ago

wgong commented 7 months ago

left chat-ollama running on Ubuntu (via npm run dev) overnight, next morning, chat UI becomes non-responsive.

kill and re-run npm does not help.

Check ollama: systemctl status ollama which is in active status, ollama run codellama is responsive at terminal.

Last resort: reboot the machine, then chat-ollama is back to normal.

Wonder if the hand-shake between chat-ollama and localhost:11434 should have timeout, rather than waiting forever.

sugarforever commented 7 months ago

I need to look into it a bit. Not sure what drives the ChatOllama hung.

Are you interested in looking into this issue? 😃 Looking forward to more experts to build ChatOllama together.

wgong commented 7 months ago

I need to look into it a bit. Not sure what drives the ChatOllama hung.

Are you interested in looking into this issue? 😃 Looking forward to more experts to build ChatOllama together.

Sure, I can try but since am new to Vue/typescript, and not yet familiar with the code base, can you give me a hint on which source files I should start looking into? Thanks