iperov / DeepFaceLive

Real-time face swap for PC streaming or video calls
GNU General Public License v3.0
26.03k stars 4.43k forks source link

How to use Xseg-dst #63

Closed nexon33 closed 2 years ago

nexon33 commented 2 years ago

I have made a model and using xseg I have excluded the mouth when open and trained it, and it masks as desired. But when I export this model to dfm and use it in deepfacelive the mouth is not excluded. I can however use deepfacelabs merge SAEHD and set mask_mode to Xseg-dst. This gives the desired result.

Is there any way to achieve the same in deepfacelive?

iperov commented 2 years ago

not related to DeepFaceLive

iperov commented 2 years ago

generic xseg model has low performance to work in real time.

nexon33 commented 2 years ago

generic xseg model has low performance to work in real time.

Is there any way to still try this and see how well it does?

iperov commented 2 years ago

no, code it for yourself

nexon33 commented 2 years ago

no, code it for yourself

I took a quick look at the code but I have no idea on how to do that, can you point me in the right direction? I'm willing to pay for the modification