feat: auto-prompt microphone permission

normal-computing / fuji-web

Fuji is an AI agent that lives in your browser's sidepanel. You can now get tasks done online with a single command!

Apache License 2.0

252 stars 24 forks source link

feat: auto-prompt microphone permission #84

Closed lynchee-owo closed 6 months ago

lynchee-owo commented 6 months ago

todo

investigate and handle the problem Faris mentioned about microphone not working with airpods.

demo

https://github.com/normal-computing/web-wand/assets/125778696/c57024c6-fafe-426a-86ab-9787c900d084

mondaychen commented 6 months ago

looks good, but I think we should only ask for permission when user turns on the audio mode within this PR. It shouldn't require using offscreen API. You can learn from the message set up in domOperations. When we need to prompt for audio permission, we send a message with chrome.tabs.sendMessage (see pagePRC) to insert iframe and request permission