gencay / vscode-chatgpt

An unofficial Visual Studio Code - OpenAI ChatGPT integration
ISC License
3.5k stars 760 forks source link

Does not take into account previous messages in the conversation when using API key. #80

Closed Vando7 closed 1 year ago

Vando7 commented 1 year ago

Not sure if this is a limitation on OpenAI's part, but asking followup questions does not work when I am logged in with an API key.

image

gencay commented 1 year ago

Hi there, due to token limitations it's not recommended to have conversations in gpt api key method. I heard enough feedback to not make it default since conversational history requires a linearly increasing token count for followup questions. After 2 questions you most likely fill up your allowed max tokens with it.

The recommended way to utilize conversations is using chatgpt/autologin method.

Vando7 commented 1 year ago

I see, makes sense.