microsoft / vscode-copilot-release

Feedback on GitHub Copilot Chat UX in Visual Studio Code.
https://marketplace.visualstudio.com/items?itemName=GitHub.copilot-chat
Creative Commons Attribution 4.0 International
346 stars 37 forks source link

Back and forth suggestions without providing a solution #1727

Open OzOkhotnik opened 1 month ago

OzOkhotnik commented 1 month ago

Type: Bug

I'm not a hugely experienced code and am trying use Copilot to resolve a problem within my code base. In this case copilot is bouncing back and forth on an issue, first telling me to import something, then telling me to remove it because it isn't being used. This has gone back and forth several times with Copilot just regurgitating the n-2 solution. It doesn't seem to be looking at either the codebase correctly (I'm using @workspace, naming the file and have only the relevent files open) or its previous answers. The issues isn't the particular solution to my problem, but Copilot's behaviour and inability to reflect on / compare current to previous answers and say, that wasn't the solution, lets try something else.

Extension version: 0.22.2024100401 VS Code version: Code - Insiders 1.95.0-insider (c33745f66ce1cd626c3282112671e2a66471ce4f, 2024-10-04T05:03:41.673Z) OS version: Windows_NT x64 10.0.22635 Modes:

System Info |Item|Value| |---|---| |CPUs|11th Gen Intel(R) Core(TM) i7-1165G7 @ 2.80GHz (8 x 2803)| |GPU Status|2d_canvas: enabled
canvas_oop_rasterization: enabled_on
direct_rendering_display_compositor: disabled_off_ok
gpu_compositing: enabled
multiple_raster_threads: enabled_on
opengl: enabled_on
rasterization: enabled
raw_draw: disabled_off_ok
skia_graphite: disabled_off
video_decode: enabled
video_encode: enabled
vulkan: disabled_off
webgl: enabled
webgl2: enabled
webgpu: enabled
webnn: disabled_off| |Load (avg)|undefined| |Memory (System)|15.70GB (4.57GB free)| |Process Argv|--crash-reporter-id 105993e2-7ea4-4258-96d4-6b6d69f6f30d| |Screen Reader|no| |VM|0%|
A/B Experiments ``` vsliv368:30146709 vspor879:30202332 vspor708:30202333 vspor363:30204092 vscod805cf:30301675 vsaa593cf:30376535 py29gd2263:31024238 c4g48928:30535728 a9j8j154:30646983 962ge761:30841072 pythongtdpath:30726887 welcomedialogc:30812479 pythonnoceb:30776497 asynctok:30898717 dsvsc014:30777825 dsvsc015:30821418 pythonmypyd1:30859725 h48ei257:31000450 pythontbext0:30879054 accentitlementst:30870582 dsvsc016:30879898 dsvsc017:30880771 dsvsc018:30880772 cppperfnew:30980852 pythonait:30973460 f3je6385:31013174 a69g1124:31018687 dvdeprecation:31040973 dwnewjupyter:31046869 newcmakeconfigv2:31071590 nb_pri_only:31057983 nativerepl1:31134653 refactort:31084545 pythonrstrctxt:31093868 flighttreat:31119334 wkspc-onlycs-t:31132770 nativeloc1:31118317 wkspc-ranged-t:31151552 cf971741:31144450 e80f6927:31120813 defaultse:31146405 12bdf347:31141542 iacca1:31150324 notype1:31143044 showchatpanel:31139797 f8igb616:31140137 ```
mjbvz commented 2 weeks ago

Can you share an example set of questions?