Vhonowslend / StreamFX-Public

StreamFX is a plugin for OBS® Studio which adds many new effects, filters, sources, transitions and encoders! Be it 3D Transform, Blur, complex Masking, or even custom shaders, you'll find it all here.
https://s.xaymar.com/streamfx-dc
GNU General Public License v2.0
3.93k stars 2.98k forks source link

"Subject" / Depth of Field Mask Type #507

Closed Trenly closed 3 years ago

Trenly commented 3 years ago

Description

It would be nice to have a depth of field mask for effects such as blurring. This mask would function similar to using a greenscreen and chromakey to remove a background but would not require a chroma background to function. One of the best examples of depth of field or "Subject" masking would be in Microsoft Teams Desktop, where you can apply a background or blur automatically. Integrating a similar functionality into StreamFX would allow amateur streamers to get started more easily by blurring or removing their background even without a greenscreen / bluescreen. This does not necessarily have to be as precise as a chromakeyed source map,

Primary Functions:

Checklist

skeletonbow commented 3 years ago

Nvidia Broadcast Engine has this functionality using their RTX broadcast features I believe. Tapping into that is probably the only viable way to see a feature like that in OBS I believe.

Xaymar commented 3 years ago

As there is no GPLv3 compatible solution out there so far, this is impossible without the first checkbox being checked. As an alternative, consider using NVIDIA Broadcast Engine, or an Intel RealSense camera.

Xaymar commented 3 years ago

NVIDIA has released their AI based masking under MIT, so this may make it in.

Xaymar commented 3 years ago

Target is v0.11.

Xaymar commented 3 years ago

Move to 0.12 due to time constraints. 0.11 is supposed to go into Beta soon, which locks down all new features.