nomic-ai / gpt4all

GPT4All: Chat with Local LLMs on Any Device
https://gpt4all.io
MIT License
66.7k stars 7.34k forks source link

gpt4all API Server issue #2470

Open alijundi opened 1 week ago

alijundi commented 1 week ago

Hi guys,

I have been testing gpt4all using the assistant on windows. It is working fine. However, when I call the same sequence

role user role assistant role user role assistant role use

above sequence for example it seems that the API reads all like if the user sent all in one message and the response is not the same when using the client on windows!

I can see all messages appear in the server chat as if it all came in one message and this is not following the conversation sequence (user then assistance then user.....)

I double checked the json file going to the API and the roles are in sequence and correct.

Is there a bug here or what shall I do? I need to use gpt4al via the API

alijundi commented 1 week ago

I noticed that we don't remember the context in the APi server which renders working via APi useless

```

// don't remember any context resetContext();