search

pieces-app / support

11 stars 1 forks source link

Copilot Chats incorrectly labels C# code as JavaScript #159

Open codename-irvin opened 2 months ago

codename-irvin commented 2 months ago

Software

Desktop Application

Operating System

macOS

Your Pieces OS Version

8.1.0

Kindly describe the bug and include as much detail as possible on what you were doing so we can reproduce the bug.

Desktop application version is 2.11.0

Observed behavior: In the image below, you can see that ChatGPT was asked to generate C# code, which it did. However, Pieces incorrectly labels the code snippet as JavaScript.

Expected behavior: The snippet of code should correctly be labeled as C#.

I was able to reproduce the same issue on the Windows desktop app as well. Same versions.

Screenshot 2024-04-12 at 10 05 44 AM
mack-at-pieces commented 2 months ago

Hi @codename-irvin - Thanks for sharing here. Do you mind sharing the prompt you used and the LLM runtime you were using so that I can try and reproduce this? Thanks!

codename-irvin commented 2 months ago

@mack-at-pieces the prompt that I used was "Iterate over a list in C#". I just tested with GPT 3.5, GPT 4, PaLM 2, and Gemini. Interestingly, I was able to reproduce for all but Gemini. With Gemini, it correctly labeled the snippet as C#. The others all labeled the snippet as JavaScript.