microsoft / vscode-copilot-release

Feedback on GitHub Copilot Chat UX in Visual Studio Code.
https://marketplace.visualstudio.com/items?itemName=GitHub.copilot-chat
Creative Commons Attribution 4.0 International
348 stars 37 forks source link

Bug in the response of Copilot Chat: endless repetition. #1490

Open warnov opened 3 months ago

warnov commented 3 months ago

Steps to Reproduce:

As this was a non-deterministic response from the LLM, it could be too hard to replicate. But this is the context conversation:

warnov what wifi bands can the 8266 work?

GitHub Copilot The ESP8266 microcontroller supports the 2.4 GHz Wi-Fi band. It does not support the 5 GHz Wi-Fi band. Here are the specifics:

Frequency: 2.4 GHz Standards: 802.11 b/g/n Channels: 1-14 (depending on the region) This means the ESP8266 can connect to Wi-Fi networks operating on the 2.4 GHz band and using the 802.11 b, g, or n standards.

warnov what micros support 5ghz?

GitHub Copilot Microcontrollers that support 5 GHz Wi-Fi are less common than those supporting only 2.4 GHz. However, some newer microcontrollers and modules do support dual-band (both 2.4 GHz and 5 GHz) Wi-Fi. Here are a few examples:

ESP32: ESP32-S2: Supports only 2.4 GHz. ESP32-S3: Supports only 2.4 GHz. ESP32-C3: Supports only 2.4 GHz. ESP32-D0WDQ6: Supports only 2.4 GHz. ESP32-WROOM-32: Supports only 2.4 GHz. ESP32-WROVER: Supports only 2.4 GHz. ESP32-WROOM-32E: Supports only 2.4 GHz. ESP32-WROVER-E: Supports only 2.4 GHz. ESP32-WROOM-32U: Supports only 2.4 GHz. ESP32-WROVER-IE: Supports only 2.4 GHz. ESP32-WROOM-32D: Supports only 2.4 GHz. ESP32-WROVER-B: Supports only 2.4 GHz. ESP32-WROVER-IB: Supports only 2.4 GHz. ESP32-WROVER-KIT: Supports only 2.4 GHz. ESP32-WROVER-KIT-V4.1: Supports only 2.4 GHz. ESP32-WROVER-KIT-V4.1: Supports only 2.4 GHz. ESP32-WROVER-KIT-V4.1: Supports only 2.4 GHz. ESP32-WROVER-KIT-V4.1: Supports only 2.4 GHz. ESP32-WROVER-KIT-V4.1: Supports only 2.4 GHz. ESP32-WROVER-KIT-V4.1: Supports only 2.4 GHz. ESP32-WROVER-KIT-V4.1: Supports only 2.4 GHz. ESP32-WROVER-KIT-V4.1: Supports only 2.4 GHz. ESP32-WROVER-KIT-V4.1: Supports only 2.4 GHz. ESP32-WROVER-KIT-V4.1: Supports only 2.4 GHz. ESP32-WROVER-KIT-V4.1: Supports only 2.4 GHz. ESP32-WROVER-KIT-V4.1: Supports only 2.4 GHz. ESP32-WROVER-KIT-V4.1: Supports only 2.4 GHz. ESP32-WROVER-KIT-V4.1: Supports only 2.4 GHz. ... ...

And after many lines lie that, it ended with:

ESP32-WROVER-KIT-V4.1: Supports only 2.4 GHz. ESP32-WROVER-KIT-V4.1: Supports only 2.4 GHz. ESP32-WROVER-KIT-V4.1: Supports only Sorry, no response was returned.

lramos15 commented 3 months ago

I recommend using the release version when using stable VS Code. It should be chat version 0.18.2

mythemeria commented 3 months ago

I have this bug too in the release version. I am often working with large random integers and strings in python. Sometimes copilot will decide to write example code that includes an attempted example of one of these, and it will just keep writing the string or int.