Closed niceapps-ch closed 4 months ago
@niceapps-ch Can you still reproduce this bug in 2.5.1? The behavior is different for me (Ollama / CodeLlama), depending on a new chat or existing history. The context (selected code) is resent when I ask your follow-up question, but the response is not what I expected (practically the same as the first response) 😅
@reneleonhardt Yes, still acts the same way in 2.5.1. The thing is, the request for the follow up question will still include the selected code (if you still have it selected in the editor) but does not include the previous messages. So the LLM has no context of the conversation and acts as if you start a new conversation with your "follow up question" and the selected code.
When you connect CodeGPT to LM Studio you can actually see the request in the log window of LM Studio, which helps for debugging.
@reneleonhardt And also here I have to add that it seems only to be an issue when using the Custom OpenAI Service configuration.
Duplicate of #384
If this issue is still reproducible with a provider other than LM Studio, then please reopen the ticket.
I think I have the same issue.
I'm using the "Custom OpenAI" provider to connect to my local CodeLlama32B LLM provided by https://github.com/YellowRoseCx/koboldcpp-rocm, which I'm using for GPU acceleration. It has an OpenAI compatible API, so I think that should work.
Now, I can ask a question and also provide a file for context and receive an answer.
At the end of each answer is this line, though:
Unknown API response. Code: 200, Body:
Now, when I ask a follow up question, the context is lost / not sent to the LLM and thus it can't make any sense of my follow up question.
Not sure what I can do about that...
I'm now using LM Studio for hosting the LLM, which I wasn't aware of yet and it looks like that this is now working properly.
What happened?
Since version 2.3.1 it is not sending the message history of a chat tab, but only the system prompt and the latest message.
This is the request of the second message:
And here the chat window.![image](https://github.com/carlrobertoh/CodeGPT/assets/58724872/6f712552-0c35-4b5b-8038-157d5f92538e)
Relevant log output or stack trace
No response
Steps to reproduce
CodeGPT version
2.4.0
Operating System
macOS