FlowiseAI / Flowise

Drag & drop UI to build your customized LLM flow
https://flowiseai.com
Apache License 2.0
31.81k stars 16.58k forks source link

[BUG]Ask for help!!!!Connection never succeeds using local chat model #3529

Open kevinwang20241004 opened 1 week ago

kevinwang20241004 commented 1 week ago

Describe the bug Local model loading always connects with error

To Reproduce 1、Start localai service

截屏2024-11-17 13 42 20 截屏2024-11-17 13 38 45 截屏2024-11-17 13 21 20

2、Build process

截屏2024-11-17 13 40 33

3、 See error

截屏2024-11-17 13 42 20 截屏2024-11-17 13 44 18

Setup

HenryHengZJ commented 1 week ago

can you try this: image

https://docs.flowiseai.com/integrations/langchain/chat-models/chatlocalai#flowise-setup