abb128 / LiveCaptions

Linux Desktop application that provides live captioning
GNU General Public License v3.0
1.15k stars 31 forks source link

Does not pick up the audio from Zoom Flatpak app #83

Open Sunspark-007 opened 8 months ago

Sunspark-007 commented 8 months ago

Hi, this is with using the Live Captions Flatpak with the Zoom Linux Flatpak app, not the web browser.

Receiving audio does work with YouTube through the web browser. Clicking on the microphone icon, Live Captions was able to receive my audio through the headset while I had the Zoom app running, but it could not at all pick up the audio from any of the attendees from the app. The app is configured to send the audio to the headset audio device.

Zoom is problematic for captions because while some organizations or people have captions as a service subscription, others don't, and you have no way at all of knowing what they have until you are in the meeting. It is not safe to assume a government service will have it, because this one didn't.

Using the web browser to join a Zoom meeting is an option and it should work since YouTube works, but the browser is not feature parity so features are limited.

That said, fantastic app, hope it will be possible to solve this issue.

develcooking commented 7 months ago

2023-11-23-201738_hyprshot

You can rewire all your audio to Live Caption via Helvum or an application like it

Sunspark-007 commented 7 months ago

@CoolerWuffi Thank you for this tip! I tried Helvum at first, figured out how it worked but I found the UI difficult because among other things, connections seemed to have different colours of dashes or solid lines.. but since it is a GTK app and I have KDE set up here, I found the same kind of app by name of qpwgraph which uses QT and allows profiles, etc. First time I have ever worked with an app like this, pretty cool.

So what I did here was draw a single mono connection from the Zoom output to the front-left input of live caption. It probably also would have worked to draw a line from the monitor of the jabra mono headset to the lcap FL, probably this is something that should be done someday because then it would work with everything using the headset as right now it's configured for the Zoom app only. I did also test drawing a connection from the jabra capture to the lcap FL and that worked to show my own speech.

qpwgraph2