microsoft / vscode-copilot-release

Feedback on GitHub Copilot Chat UX in Visual Studio Code.
https://marketplace.visualstudio.com/items?itemName=GitHub.copilot-chat
Creative Commons Attribution 4.0 International
297 stars 28 forks source link

Different versions of GPT reported by Copilot in VS Code #1261

Open informatik01 opened 1 month ago

informatik01 commented 1 month ago

Hi.

I have a GitHub Copilot subscription and have both the GitHub Copilot "main" extension (ID: GitHub.copilot) and its companion extension GitHub Copilot Chat (ID: GitHub.copilot-chat) installed.

Today I've just discovered that when you ask the same question about GPT version that GitHub Copilot is based on, it reports different versions depending on where you ask it in VS Code:

Here is a screenshot for illustration: image

🙋‍♂️ Is it a bug or is it a known "issue" or is it meant to be so?


Both VS Code and Copilot extensions versions are the latest at the time of writing this.

digitarald commented 1 month ago

Yes, I can confirm Copilot is multi-model and we keep running experiments to pick the most balanced models for performance and quality.

But models are generally bad at telling which version they are unless we tell them. So there is a bug you hit that inline chat is (most often) 3.5, not 3. So far most people asked in panel chat, which gets a model hint.

informatik01 commented 1 month ago

@digitarald OK, thanks for the info.