Incomplete chat responses

[chrmarti]

From @michaelyorkpa in https://github.com/orgs/community/discussions/129030:

Select Topic Area

Bug

Body

I have an individual, monthly subscription to Github Copilot.

Environment

I am using VSCode 1.90.1 on Windows 10 Pro with Github Copilot 1.204.0 and Github Copilot chat 0.16.1.

Problem Description

Up until 0.16.0 rolled out, both chat and code completion worked very well. Code completion still seems to work well.

Since 0.16.0, chat rarely completes entire responses, often stopping at just a few words. The interface shows "Generating..." and there is a stop button. As I'm writing this, it has been generating for over 15 minutes.

Am I hitting some sort of rate limit that isn't being communicated back to me?

Troubleshooting Steps Taken

I have tried uninstalling and re-installing both plugins, and each plugin one at a time previously.

I have restarted both VSCode and my machine several times.

I am using AdGuard home on my network and have disabled that as well in case an API call was being blocked.

None of these changes have made any difference to the chat's issues.

Please advise if you have any other troubleshooting steps, would like any more debug information, or anything else. I have included VSCode details, logs, and a screenshot of the frozen chat below.

Thank you very much for your time.

VSCode Information

Version: 1.90.1 (system setup) Commit: 611f9bfce64f25108829dd295f54a6894e87339d Date: 2024-06-11T21:01:24.262Z Electron: 29.4.0 ElectronBuildId: 9593362 Chromium: 122.0.6261.156 Node.js: 20.9.0 V8: 12.2.281.27-electron.0 OS: Windows_NT x64 10.0.19045

Logs

2024-06-18 20:55:14.761 [info] [streamChoices] request done: headerRequestId: [ca7151c4-057e-48c4-865c-e04b27c050b3] model deployment ID: [z774de7b35e87] 2024-06-18 20:55:15.393 [info] [code-referencing] Calling Match 2024-06-18 20:55:15.462 [info] [code-referencing] No match found 2024-06-18 20:55:15.718 [info] [fetchCompletions] request.response: [https://copilot-proxy.githubusercontent.com/v1/engines/copilot-codex/completions] took 160 ms 2024-06-18 20:55:15.719 [info] [streamChoices] solution 0 returned. finish reason: [stop] 2024-06-18 20:55:15.719 [info] [streamChoices] request done: headerRequestId: [66aee182-1fc0-4278-9ca4-f3185074fa7e] model deployment ID: [z774de7b35e87] 2024-06-18 20:55:52.983 [info] [fetchCompletions] request.response: [https://copilot-proxy.githubusercontent.com/v1/engines/copilot-codex/completions] took 305 ms 2024-06-18 20:55:52.984 [info] [streamChoices] solution 0 returned. finish reason: [stop] 2024-06-18 20:55:52.985 [info] [streamChoices] request done: headerRequestId: [3b0da052-2322-4484-bd90-06ce0c016428] model deployment ID: [z774de7b35e87] 2024-06-18 20:55:54.823 [info] [fetchCompletions] request.response: [https://copilot-proxy.githubusercontent.com/v1/engines/copilot-codex/completions] took 193 ms 2024-06-18 20:55:54.824 [info] [streamChoices] solution 0 returned. finish reason: [stop] 2024-06-18 20:55:54.825 [info] [streamChoices] request done: headerRequestId: [f9816360-4f43-426b-ab03-c868cc808ab6] model deployment ID: [z774de7b35e87] 2024-06-18 20:55:55.719 [info] [fetchCompletions] request.response: [https://copilot-proxy.githubusercontent.com/v1/engines/copilot-codex/completions] took 233 ms 2024-06-18 20:55:55.720 [info] [streamChoices] solution 0 returned. finish reason: [stop] 2024-06-18 20:55:55.721 [info] [streamChoices] request done: headerRequestId: [610cf494-f562-4bcb-b4ae-6a9e20982f60] model deployment ID: [z774de7b35e87] 2024-06-18 20:55:57.760 [info] [fetchCompletions] request.response: [https://copilot-proxy.githubusercontent.com/v1/engines/copilot-codex/completions] took 244 ms 2024-06-18 20:55:57.761 [info] [streamChoices] solution 0 returned. finish reason: [stop] 2024-06-18 20:55:57.762 [info] [streamChoices] request done: headerRequestId: [e6539e21-9a59-4021-9399-5ea2807aaccb] model deployment ID: [z774de7b35e87] 2024-06-18 20:56:02.812 [info] [fetchCompletions] request.response: [https://copilot-proxy.githubusercontent.com/v1/engines/copilot-codex/completions] took 225 ms 2024-06-18 20:56:02.813 [info] [streamChoices] solution 0 returned. finish reason: [stop] 2024-06-18 20:56:02.814 [info] [streamChoices] request done: headerRequestId: [b63e439c-658e-4f61-8d29-5efc98340877] model deployment ID: [z774de7b35e87]

Screenshot of Frozen Chat

[michaelyorkpa]

Thank you for your help, Christof!

[lramos15]

Can you attach your copilot chat logs from the latest version?

CTRL / CMD + SHIFT +U -> GitHub Copilot Chat.

[michaelyorkpa]

Here's today's. It is still frozen at "Generating..." now after responding to: What would be the best way to create a composite key for the table highlighted in the code? The only guaranteed to be not null field in this is piesItemsId, but there are multiple piesItemsIds

It responded with: To create a composite key for the

I only used it once and that was for the purpose of providing this log:

2024-07-29 11:00:11.176 [info] [FetcherService] Using the Helix fetcher. 2024-07-29 11:00:11.176 [info] [gitExtensionService] Initializing Git extension service. 2024-07-29 11:00:11.176 [info] [gitExtensionService] Successfully activated the vscode.git extension. 2024-07-29 11:00:11.176 [info] [gitExtensionService] Enablement state of the vscode.git extension: true. 2024-07-29 11:00:11.176 [info] [gitExtensionService] Successfully registered Git commit message provider. 2024-07-29 11:00:11.176 [info] [auth] Logged in as michaelyorkpa 2024-07-29 11:00:11.176 [info] [auth] Logged in as michaelyorkpa 2024-07-29 11:00:11.401 [info] [chat] copilot token chat_enabled: true 2024-07-29 11:00:11.419 [info] [auth] Got Copilot token for michaelyorkpa 2024-07-29 11:00:11.426 [info] [githubTitleAndDescriptionProvider] Successfully activated the GitHub.vscode-pull-request-github extension. 2024-07-29 11:00:11.426 [info] [githubTitleAndDescriptionProvider] Initializing GitHub PR title and description provider provider. 2024-07-29 11:00:11.426 [info] [githubTitleAndDescriptionProvider] Successfully registered GitHub PR title and description provider. 2024-07-29 11:00:11.433 [info] [chat] copilot token chat_enabled: true 2024-07-29 11:00:11.433 [info] [auth] Got Copilot token for michaelyorkpa 2024-07-29 11:00:11.536 [info] [auth] Logged in as michaelyorkpa 2024-07-29 11:00:11.540 [info] [chat] copilot token chat_enabled: true 2024-07-29 11:00:11.540 [info] [auth] Got Copilot token for michaelyorkpa 2024-07-29 11:25:11.425 [info] [auth] Logged in as michaelyorkpa 2024-07-29 11:25:11.712 [info] [chat] copilot token chat_enabled: true 2024-07-29 11:25:11.712 [info] [auth] Got Copilot token for michaelyorkpa 2024-07-29 11:50:11.718 [info] [auth] Logged in as michaelyorkpa 2024-07-29 11:50:11.989 [info] [chat] copilot token chat_enabled: true 2024-07-29 11:50:11.989 [info] [auth] Got Copilot token for michaelyorkpa 2024-07-29 12:15:11.999 [info] [auth] Logged in as michaelyorkpa 2024-07-29 12:15:12.257 [info] [chat] copilot token chat_enabled: true 2024-07-29 12:15:12.257 [info] [auth] Got Copilot token for michaelyorkpa 2024-07-29 12:40:12.276 [info] [auth] Logged in as michaelyorkpa 2024-07-29 12:40:12.491 [info] [chat] copilot token chat_enabled: true 2024-07-29 12:40:12.491 [info] [auth] Got Copilot token for michaelyorkpa 2024-07-29 13:05:12.500 [info] [auth] Logged in as michaelyorkpa 2024-07-29 13:05:12.748 [info] [chat] copilot token chat_enabled: true 2024-07-29 13:05:12.748 [info] [auth] Got Copilot token for michaelyorkpa 2024-07-29 13:30:12.757 [info] [auth] Logged in as michaelyorkpa 2024-07-29 13:30:13.060 [info] [chat] copilot token chat_enabled: true 2024-07-29 13:30:13.060 [info] [auth] Got Copilot token for michaelyorkpa 2024-07-29 13:55:13.066 [info] [auth] Logged in as michaelyorkpa 2024-07-29 13:55:13.382 [info] [chat] copilot token chat_enabled: true 2024-07-29 13:55:13.382 [info] [auth] Got Copilot token for michaelyorkpa 2024-07-29 14:20:13.389 [info] [auth] Logged in as michaelyorkpa 2024-07-29 14:20:13.668 [info] [chat] copilot token chat_enabled: true 2024-07-29 14:20:13.668 [info] [auth] Got Copilot token for michaelyorkpa 2024-07-29 14:45:13.676 [info] [auth] Logged in as michaelyorkpa 2024-07-29 14:45:13.926 [info] [chat] copilot token chat_enabled: true 2024-07-29 14:45:13.926 [info] [auth] Got Copilot token for michaelyorkpa 2024-07-29 15:10:13.937 [info] [auth] Logged in as michaelyorkpa 2024-07-29 15:10:14.179 [info] [chat] copilot token chat_enabled: true 2024-07-29 15:10:14.179 [info] [auth] Got Copilot token for michaelyorkpa 2024-07-29 15:35:14.191 [info] [auth] Logged in as michaelyorkpa 2024-07-29 15:35:14.430 [info] [chat] copilot token chat_enabled: true 2024-07-29 15:35:14.430 [info] [auth] Got Copilot token for michaelyorkpa 2024-07-29 15:58:39.240 [info] [chat fetch] request.response: [https://api.githubcopilot.com/chat/completions], took 867 ms

Just to confirm, these are the versions I have installed: GitHub Copilot v1.219.0 and GitHub Copilot Chat v0.17.1

About data from VS Code: Version: 1.91.1 (system setup) Commit: f1e16e1e6214d7c44d078b1f0607b2388f29d729 Date: 2024-07-09T22:06:49.809Z Electron: 29.4.0 ElectronBuildId: 9728852 Chromium: 122.0.6261.156 Node.js: 20.9.0 V8: 12.2.281.27-electron.0 OS: Windows_NT x64 10.0.19045

Thank you, in advance, for the help!

[lramos15]

Interesting, the logs seem to indicate that you received a response so just trying to understand what is happening.

If you could please also try insiders https://code.visualstudio.com/insiders/ + the latest copilot chat pre-release. The pre-release will match the current date in version. That will help us get more logs and iterate on this more quickly

[michaelyorkpa]

I received a response, but it stopped during the first line. It's actually still "generating" now, hours later. See screenshot below.

I will download and install that then. The service is currently down, 17:31 Eastern US time.

[lramos15]

I see no downtime on my side 🤔 .

Please let me know when you get a chance to download the pre-release version. I haven't seen this issue before, it's very interesting.

[michaelyorkpa]

I have downloaded and installed the insider version along with the pre-release versions of all of my usual extensions. So far, no issues, but I've only done two queries.

[michaelyorkpa]

Well, I don't know what's different between 0.18.2024072603 (pre-release) of the GitHub Copilot Chat extension and the 0.17.1 version, but after about a dozen questions, it has yet to freeze at the Generating stage. I'll update this over the next day or two if that changes. But this issue started with 0.16.0 and has been here since then.