microsoft / vscode-copilot-release

Feedback on GitHub Copilot Chat UX in Visual Studio Code.
https://marketplace.visualstudio.com/items?itemName=GitHub.copilot-chat
Creative Commons Attribution 4.0 International
297 stars 28 forks source link

Regression: Pre-release Commit Message generation repeats old commit messages #1183

Open nevercast opened 2 months ago

nevercast commented 2 months ago

Steps to Reproduce:

  1. Write some commits in a project, use the Copilot Commit Message Generation as much as possible ✨
  2. Notice that the commit messages deteriorate to uselessness, just repeating previous changes, becomes unrelated to the diff.

A recent change to VSCode added commit message history to the commit message completion functionality. An excellent idea, however, I suspect the prompt is poor, or there is an underlying bug. (Leaky LLM abstractions are pain, I get it.)

When I'm generating commit messages, I expect the commit to discuss the change, but the behaviour I'm now seeing is that the generated message just repeats aspects of the previous messages.

I'd like to see an option to either:

  1. Disable commit history included in the prompt
  2. Modify the prompt
  3. The prompt resolved by the copilot team.
senkenn commented 1 month ago

Same on v1.90.0.

[UPD] WIndows worked well but Ubuntu not work.