Exceeding context window makes the bot incoherent (answering unrelated prompts)

[sumergoconicio]

I believe there is still an error in the context window implementation. In the last few chats, when the context limit is exceeded, the error message does not pop up BUT the topic of the responses becomes incoherent with the bot responses diverging wildly from the actual topic under discussion in that chat.

It was a pretty weird error actually, because it was answering as if asked some prompt in one of my earlier chats, as if it reverted to some cache to continue the conversation.

[AxelBL]

This behaviour is still there. When exceeding a certain context length the assistant is replying with unrelated answers. I guess history/message management has to get implemented.