search

lisiur / ChatWizard

OpenAI chat client desktop app (Windows, MacOS, Linux)
MIT License
150 stars 11 forks source link

Anyone has success with localAI? #56

Closed mounta11n closed 1 year ago

mounta11n commented 1 year ago

Describe the bug ChatWizard does communicate with LocalAI, but a response is still not appearing.

To Reproduce Steps to reproduce the behavior:

  1. Start localAI
  2. Start ChatWizard
  3. In ChatWizard configure localAI as a forward URL like for example http://127.0.0.1:8080
  4. In ChatWizard edit the models list and add a name of a model that is inside localAI's models folder (with extension, for example WizardLM_Uncen-7B-q5K.bin)
  5. Start a new chat and choose the local model

Expected behavior In your terminal window, where localAI is running, you should see that it correctly starts loading the model. But a response will never arrive at ChatWizard

Screenshots Imgur

App Info: Copy from app about:

Would be cool if anyone has figured out what the problem is and how to solve it.

lisiur commented 1 year ago

Are you using this one? https://github.com/go-skynet/LocalAI

I have reproduced it locally and fixed it.

mounta11n commented 1 year ago

Oh wow, that was incredibly fast! I've installed 0.4.1 and it is working like a charm now. Thanks very much : )