microsoft / vscode

Visual Studio Code
https://code.visualstudio.com
MIT License
160.45k stars 28.1k forks source link

Voice: allow to respond chat contents with voice for a true conversation #196261

Closed isidorn closed 1 month ago

isidorn commented 8 months ago

Now I want to hear Copilot respond. It is a nice pair, I talk and I hear the response back. Ideally there is some easy toggle to mute Copilot.

### Tasks
- [x] Explore UI of others (Bing, OpenAI)
- [x] Auto synthesise when voice was used by changing mic icon to speaker icon
- [x] Have action per chat block to synthesize
- [x] Explore SML: can it be used to control playback speed or skip over code?
bpasero commented 8 months ago

Yes, I love the idea and I think with the SDK we have everything we need for it.

I love how Bing does this, when an answer is there you can have it read out with voice but also have a way to stop that:

Recording 2023-10-25 at 10 35 17

//cc @joaomoreno @kieferrm

isidorn commented 8 months ago

Yup - I like that flow 😍

SPiercer commented 5 months ago

upvoting since the new "Hey Code" feature is out it would be amazing

ssalbdivad commented 4 months ago

I've been looking for this feature since Chat was announced!

Would be a great way to rubber duck and make chat much more helpful in complex projects where it doesn't do as well providing code directly.

bpasero commented 2 months ago

Pointer: https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-speech-synthesis?tabs=browserjs%2Cterminal&pivots=programming-language-cpp

bpasero commented 1 month ago

A first version is in insiders: