search

locaal-ai / obs-backgroundremoval

An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.
GNU General Public License v2.0
2.97k stars 203 forks source link

New BG segmentation models #2

Closed ankitbko closed 3 years ago

ankitbko commented 3 years ago

Checkout this and see if this gives better result https://elder.dev/posts/open-source-virtual-background/

I am not C++ developer so unfortunately cannot contribute directly over here. Hopefully this will help.

royshil commented 3 years ago

that solution is using a general purpose net (MobileNetV1) which is fine. I can try to include several models to switch between to get the best result

simonbunge commented 3 years ago

Great work, @royshil!! While your at adding selectable models, MODNet would be a cool one to try. A pre-made ONNX version is available, so should be straightforward enough. Not that I have looked into any detail, but a few tweaks to input/ output scaling and normalisation should do it. Let me know if you want any help.

simonbunge commented 3 years ago

Thank you, @royshil. Can't believe how quickly you got that to work (as I just established it actually does). Massive kudos!!