search

pxi-gmbh / pipfy

a floating webcam image on your desktop
9 stars 1 forks source link

FEATURE: add audio ingestion to create automatic captioning in google chrome #7

Closed jochmann closed 3 years ago

jochmann commented 3 years ago

as an accessibility feature hovercam could provide automatic live captioning to a webcam on the desktop by using the new (March 2021) auto-captioning included with google Chrome.

https://blog.google/products/chrome/live-caption-chrome/

A bit unclear about how we would route the sound to avoid feedback loops or delayed echos.

EDIT: we can disable sound output from the browser to the system sound per tab in Chrome by clicking on the little speaker icon on the tab. The captioning will still work. Probably the most efficient workaround to describe this work flow in the documentation.

jochmann commented 3 years ago

Resolved in current release with pipfy.captions. Still unresolved: allow people to route local output to their mic input to subtitle all audio on their machine. That can't be resolved from a web app.

There is a workaround in Windows, using "stereo mix" as an option within the recording devices settings. Easier, but requires third party software: route audio with a virtual audio cable.