search

Vhonowslend / StreamFX-Public

StreamFX is a plugin for OBS® Studio which adds many new effects, filters, sources, transitions and encoders! Be it 3D Transform, Blur, complex Masking, or even custom shaders, you'll find it all here.
https://streamfx.vhonowslend.com
GNU General Public License v2.0
3.94k stars 3.03k forks source link

Face retouch/smooth/beautify #803

Closed summerrelax closed 2 years ago

summerrelax commented 2 years ago

Explain the Feature/Enhancement

Recently I used Snap Camera without lenses, just with default "Apply retouching to video stream when no Lens is activated" feature. It makes face looking much better. Is it possible to achieve same effect using StreamFX?

What makes this feature/enhancement useful for StreamFX and its users?

Snap Camera is heavy, proprietary. Snap Camera alternatives are same heavy and have lots of feature, while there is no lightweight solution for just face retouch task. StreamFX can be good and elegant solution for this

Checklist

Any additional Information we need to know?

Snap Camera's "Apply retouching to video stream when no Lens is activated" switch is in Settings

Xaymar commented 2 years ago

Do you know of an open source compatible library that does this?

summerrelax commented 2 years ago

I've checked GitHub and founded these repos:

https://github.com/puhach/skin-smoothing https://github.com/Gnimuc/FabSoften https://github.com/caohe/Face-Detection-and-Skin-Retouching

You also can look for similar repos by queries like "skin smoother", " face retouch", etc. Not too much, but enough to discover. I'm not sure if this is it because I'm not strong in CG. By some reason I thought that face smoothing is possible by shaders (am I right?)

summerrelax commented 2 years ago

Also check Zoom's beautify filter at Settings->Video->Touch up my appearance. Can I achieve similar effect with StreamFX?

Xaymar commented 2 years ago

Probably if you apply gaussian blur selectively to the frame in question. There isn't really a reason for StreamFX to have this at all.

r4j4h commented 2 years ago

Yep, and the selectively part could be dictated by face detection algorithm to aid in locating facial features to blur or rather using math to locate regions between the features probably

Here is example showing adding lipstick for "digital make-up" https://github.com/ageitgey/face_recognition#find-and-manipulate-facial-features-in-pictures with its corresponding code https://github.com/ageitgey/face_recognition/blob/master/examples/digital_makeup.py

Xaymar commented 2 years ago

I still do not see what StreamFX gains from this feature. It's not widely useful like current features, nor does it appear to be anything new given that apps for this exact purpose already exist. It'll be unlikely to be accepted into StreamFX, and I'll reject the request based on this judgement.

summerrelax commented 2 years ago

I've checked GitHub and founded these repos: https://github.com/puhach/skin-smoothing https://github.com/Gnimuc/FabSoften https://github.com/caohe/Face-Detection-and-Skin-Retouching You also can look for similar repos by queries like "skin smoother", " face retouch", etc. Not too much, but enough to discover. I'm not sure if this is it because I'm not strong in CG. By some reason I thought that face smoothing possible by shaders (am I right?)

чт, 21 квіт. 2022, 02:14 користувач Xaymar @.***> пише:

Do you know of an open source compatible library that does this?

— Reply to this email directly, view it on GitHub https://github.com/Xaymar/obs-StreamFX/issues/803#issuecomment-1104540554, or unsubscribe https://github.com/notifications/unsubscribe-auth/AY2G3BYDLFSKTK4MWUPGGQ3VGCFTNANCNFSM5T5OMSGA . You are receiving this because you authored the thread.Message ID: @.***>