floe / backscrub

Virtual Video Device for Background Replacement with Deep Semantic Segmentation
Apache License 2.0
735 stars 86 forks source link

Feature request - make hologram effect an option #40

Open frojnd opened 3 years ago

frojnd commented 3 years ago

I just found out about: https://elder.dev/posts/open-source-virtual-background/ But it's in python. Can someone make this work with deepbaksub? :)

BenBE commented 3 years ago

You can reach something like this effect when you combine OBS (for image composition) and the plain background mode from deepbacksub. Just pipe the image from your webcam through deepbacksub to substract the background and compose the image in OBS with additional filters (for color/CRT transformation) in OBS. Finally in OBS there's a v4l2loopback exporter plugin you can use to push that composed image over to any application that can use a webcam.

phlash commented 3 years ago

Another possible reason to support OBS more directly than via V4L2 loopback?

BenBE commented 3 years ago

First we should get the code base up to a point where it's somewhat more state of the art. Currently there's still quite a bit of work to do be done to straighten out the PoC-ness of the first implementation.