search

locaal-ai / obs-backgroundremoval

An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.
GNU General Public License v2.0
2.97k stars 203 forks source link

Feature request: edge padding. #12

Closed mctrafik closed 3 years ago

mctrafik commented 3 years ago

Good day.

Love the plugin. Good work. I feel like a few things needed to make it usable.

Here's what I got when I tried to blur my background:

Screen Shot 2021-04-30 at 6 06 03 PM

As you can see it doesn't think my hair, headset, forehead and eyebrows are part of me. And around my shoulders the transition line is very hard.

Shoulder tracking is amazing... but the issues above make this ... "interesting" to use.

Anyway, I would like to ask for a feature where instead of filling the edge at the edge of the match, if we could do so within X pixels. I.e. for my use case I don't care if I reveal 30 pixels around my shoulders, but I would really like my eyebrows (and sometimes eyes) to not be considered "background".

Like... this is funny.... but I wouldn't get on a work call like this:

Screen Shot 2021-04-30 at 6 12 28 PM

If not obvious, this happens at all threshold levels. Max 'usable' threshold level is .95 which looks like this for me:

Screen Shot 2021-04-30 at 6 14 37 PM

The other dials only make things worse.

royshil commented 3 years ago

this may be fixed by using other segmentation models - which i'm working on..

royshil commented 3 years ago

@mctrafik can you try the new models and see how it goes? if it's good - plz close the issue

ngoonee commented 3 years ago

@royshil I saw the modnet model, it seems unusable for me (0.01 threshold gives a BIT of the image, otherwise it just filters everything out).

The SI model works the same as what @mctrafik has reported, everything above my lips isn't detected as face.