search

WhiskerWeirdo / BanterBrain-Buddy

BanterBrain Buddy is a Windows based Speech-To-Text to LLM to Text-To-Speech client-program for general entertainment or as a streaming companion.
GNU General Public License v3.0
2 stars 0 forks source link

Closed Caption integration #35

Open cdusold opened 2 months ago

cdusold commented 2 months ago

Currently I use a closed caption plugin in OBS to put STT generated captions on stream. This only gets my voice, not the buddies, nor other sources of voice such as Discord. If CC can come from the always on mic ( #19 ), from all registered sources to STT ( #34 ), and the output from ChatGPT/other buddy engines (multiple enhancements list new LLMs) as part of the OBS integration ( #13 ), that would reduce the number of STT instances I'm using.

This would also allow for CCs to do speaker tags in transcripts, which could be nice for accessibility options.

WhiskerWeirdo commented 2 months ago

Regardless of doing STT for multiple input streams (which I think is a very seperate issue) for this you'd have to create a webserver that BBB would run where the STT text is outputted and use that as websource-input voor OBS.

cdusold commented 2 months ago

Yep, which is why it's a separate feature request.

I mostly meant to emphasize that if it's coming out of STT, it should be useable for CC. And also to include the buddy text for CC purposes. I rarely see the twitch pet get captions, which seems like it should be an easy fix given all the text is already available.

Making that just a formatted webserver output and having an external OBS plugin deal with it (I don't know what's available for ingesting CC text into a stream, as I've just being using a all-in-one mic to CC plugin) would be an option. If the OBS integration mentioned in #13 could take care of it though, that'd be one less plugin to run as well. #13 wasn't very descriptive, so I can guess that's not within its scope.