intitni / CopilotForXcode

The missing GitHub Copilot, Codeium and ChatGPT Xcode Source Editor Extension
https://copilotforxcode.intii.com
MIT License
7.59k stars 364 forks source link

[Enhancement]: Voice-based Copilot for use with Apple Vision Pro and mobile devices #365

Open minusreality opened 11 months ago

minusreality commented 11 months ago

Before Requesting

What feature do you want?

Would it be possible to make the Xcode UI able to be interacted with by voice for devices that do not have a keyboard such as the upcoming Apple Vision Pro, cell phones, and tablets (using remote clients to a mac)?

This is already in development for Visual Studio Code by the Github Next team, but has no Xcode support, and very little attention to mac support.

https://githubnext.com/projects/copilot-voice/

intitni commented 11 months ago

I believe this can be done with speech to text -> LLM -> Apple Scripts/self defined actions.

I am not sure if I will ever work on this, but there is a chat plugin in my todo list (No ETA, not even investigated) that may do similar things with texts. Maybe we can talk about voice support after that.