microsoft / vscode-copilot-release

Feedback on GitHub Copilot Chat UX in Visual Studio Code.
https://marketplace.visualstudio.com/items?itemName=GitHub.copilot-chat
Creative Commons Attribution 4.0 International
295 stars 28 forks source link

Copilot chat ignoring context even though it clearly is referenced #803

Open Superskyyy opened 5 months ago

Superskyyy commented 5 months ago

I'm sorry for the confusion, but as an AI, I don't have the ability to see or select code in your environment. Could you please copy and paste the code you want me to check into our conversation?

Steps to Reproduce:

  1. Select a long cpp file with 510 lines.
  2. Ask copilot to explain or do whatever, it will say it has no access to it.
  3. Select a small portion of the file (e.g. 200lines)
  4. Ask again, now it is willing to answer questions and can see code.
tecunited commented 5 months ago

I've been having the same issue for 3 days, it just suddenly mid work it suddenly stopped.

Superskyyy commented 5 months ago

I've been having the same issue for 3 days, it just suddenly mid work it suddenly stopped.

yeah, its very random

datanetai commented 5 months ago

Context size is only 3k which you can see by going output from vscode terminal.

2024-02-02 11:27:20.296 [info] [chat fetch] modelMaxPromptTokens 3072
2024-02-02 11:27:20.296 [info] [chat fetch] modelMaxResponseTokens 1498
2024-02-02 11:27:20.296 [info] [chat fetch] chat model gpt-4

It cannot process 500 lines of code! I want them to show at least error or something it is weird because it gives me random code and i do not know if it can see my code or not. Also 3k context is too small for paid product which switch to GPT3.5 mid answering anyway!

Shade53 commented 4 months ago

I am getting this issue with only 200 lines of code being presented, also running it in debian12 like OP. Just randomly started happening today when it was working a couple chats before. Upon checking my file though I see the full 200 lines of code is around 11.9KB, so it may be hitting this "3k" limit?

image

MikeImbar commented 4 months ago

I am also having the same issue with ~400 lines of code.

ShawnZuspaet commented 1 month ago

this is happening all the time to me, feels like it got worse.