search

microsoft / vscode-copilot-release

Feedback on GitHub Copilot Chat UX in Visual Studio Code.
https://marketplace.visualstudio.com/items?itemName=GitHub.copilot-chat
Creative Commons Attribution 4.0 International
321 stars 29 forks source link

Responsible AI Service is way to sensitive #1029

Open Kireobat opened 6 months ago

Kireobat commented 6 months ago

Responsible AI Service is way to sensitive.

I was working with an Arduino and making some code for it. I asked copilot this question:

Can you write an explanation for the following connections on my D1 mini please:

TX, RX, 5 SCL, 4 SDA, 0, 2, GND, VBUS, RST, AO, 16, SCK 14, MISO 12, MCSI 13, SS 15, 3V3

Which may seem totaly innocent at first glance, but Responsible AI Services was smart enough to see that I had "SS" in the request meaning that I was up to no good and probably a nazi. Responsible AI Services did the right thing and blocked my horrible and dangerous request.

I eventually figured that the "SS" might be the problem so I asked this instead:

Can you write an explanation for the following connections on my D1 mini please:

TX, RX, 5 SCL, 4 SDA, 0, 2, GND, VBUS, RST, AO, 16, SCK 14, MISO 12, MCSI 13, 15, 3V3

And this was accepted. I hope that whoever is responsible for Responsible AI Services can adjust their regex pattern so that you don't get flagged for merely including "SS" in a question.

Thanks for reading

SigismondPhilippe commented 6 months ago

That "responsible AI service" is just some stakeholders at github trying to exist. It is a very good argument to try other, better tuned, ai copilot.

thispaul commented 6 months ago

@Kireobat i'm having trouble reproducing this issue. when i use the same prompt, i get a response back from copilot chat in vs code. are you still having this problem with the same prompt?

thank you

Image

lramos15 commented 6 months ago

@thispaul I just started a new chat and copy and pasted that prompt

image
Kireobat commented 6 months ago

I still have the issue when including the "SS" image

thispaul commented 6 months ago

Thanks @Kireobat we are troubleshooting this with the RAI team

GGLionCross commented 1 month ago

I can confirm that my prompt "Please put the elapsed time in hh:mm:ss format" was also flagged.

ced-mos commented 5 days ago

I have the same issue but for another prompt. However, I haven't found the reason why. Especially as I entered a prompt in German, where I haven't anything special.

Therefore, is there the possibility to get the reason, why the information was filtered, to troubleshoot the process myself?