search

rotemtzaban / STIT

MIT License
1.2k stars 170 forks source link

face swap without removing objects #47

Open galmizush opened 1 year ago

galmizush commented 1 year ago

I have a video in which the actor is moving his hands in front of his face. When I run STIT it changes the actor's face like i intended to but removes the hands completely. Is there a way to keep the hands exactly in place and change the face just where you can see it?

GarethWright commented 1 year ago

Roto and composite in post. STIT doesn’t handle occlusions well.

On Sat, 20 May 2023 at 07:53, galmizush @.***> wrote:

I have a video in which the actor is moving his hands in front of his face. When I run STIT it changes the actor's face like i intended to but removes the hands completely. Is there a way to keep the hands exactly in place and change the face just where you can see it?

— Reply to this email directly, view it on GitHub https://github.com/rotemtzaban/STIT/issues/47, or unsubscribe https://github.com/notifications/unsubscribe-auth/AACMME5SLMXP6NC35LDYKA3XHBS7TANCNFSM6AAAAAAYIRYO6M . You are receiving this because you are subscribed to this thread.Message ID: @.***>

-- Kind regards

Gareth Wright

galmizush commented 1 year ago

it's difficult to go over every frame and bring back the hands. I tried to do it with photoshop and it took me a couple of minutes just for one frame, not to mention you have to select only specific areas of the hands depending on the frame.

GarethWright commented 1 year ago

You need to use Adobe After Effects and the roto brush mate.

That will make short work of it. On Sat, 20 May 2023 at 19:21, galmizush @.***> wrote:

it's difficult to go over every frame and bring back the hands. I tried to do it with photoshop and it took me a couple of minutes just for one frame, not to mention you have to select only specific areas of the hands depending on the frame.

— Reply to this email directly, view it on GitHub https://github.com/rotemtzaban/STIT/issues/47#issuecomment-1555966220, or unsubscribe https://github.com/notifications/unsubscribe-auth/AACMME2PTWKM64IQBICEFCLXHEDRHANCNFSM6AAAAAAYIRYO6M . You are receiving this because you commented.Message ID: @.***>

-- Kind regards

Gareth Wright

galmizush commented 1 year ago

thanks. There is another problem when in some of the pictures with objects in front of the head, the python script doesn't recognize a face and return and error because of that. Is there a way to fix this? All I need is that the script will be able to predict a face from previous or next frames and change only the visible part of the face.

johndpope commented 1 year ago

https://www.youtube.com/watch?v=h6Sw1ltQKiA&ab_channel=NerdyRodent