search

floe / backscrub

Virtual Video Device for Background Replacement with Deep Semantic Segmentation
Apache License 2.0
734 stars 85 forks source link

Recommendation: ability to change background while running. #70

Open MartinKlevs opened 3 years ago

MartinKlevs commented 3 years ago

Restarting the process could be inconvenient in some scenarios. The simplest way to do this would be to regularly check whether the background file has been replaced.

BenBE commented 3 years ago

If you need the ability to change the background at any time it's best to use a tool like OBS Studio and use deepseg only to perform the background segmentation. That's also what the s shortcut on the debug window is for, so you can disable the background replacement at any time when another tool is providing the background for you instead.

MartinKlevs commented 3 years ago

This would work fine for a pixel-sharp segmentation, however I am experimenting with smooth mask borders and a smooth transition is hard to fix properly in OBS. One could also output just the mask and mix it with the webcam in OBS, however that can lead to problems with multiple programs accesing the webcam.

Besides that, it would also be a good convenience feature, that uses less resources, and takes less effort, than mixing with OBS.

phlash commented 3 years ago

Possibly related to #43 where local file input / video stream backgrounds are discussed, tagging as an experiment to try..