jbilcke-hf / FacePoke

Select a portrait, click to move the head around (please use your own space / GPU!)
https://huggingface.co/spaces/jbilcke-hf/FacePoke
Other
665 stars 60 forks source link

It does not work on close up faces #2

Open morganavr opened 2 weeks ago

morganavr commented 2 weeks ago

Online demo at https://huggingface.co/spaces/jbilcke-hf/FacePoke does not work on this face for example. It shows orange face outline but grabbing and moving a mouse cursor around does nothing.

image

jbilcke-hf commented 2 weeks ago

Hello, that's interesting, I can reproduce this issue with this exact image,

it looks like it works with MediaPipe (detection of facial features in the frontend - the orange lines we see on hover) but not with Insightface (detection in the backend)

I know LivePortrait (what I use under the hood) doesn't work well with long hair, the hair might become blurry:

Screenshot 2024-10-06 at 18 54 21

while the original is like this: 82e52a433f4272d1e537458aa6ae3533

but in the case of your image I'm not sure what the problem is 👀

maybe someone will see this thread and have a solution?

TanvirHafiz commented 2 weeks ago

it does not work for me either. wonder whats wrong. not even with the imgae above which worked for jbilcke-hf

pedrolZasx commented 2 weeks ago

same issue i got the landmark detection but wont move first i thought the tool is broken i use other images and it's works can you pls fix it ? Straight_Front_698

jbilcke-hf commented 4 days ago

@morganavr There has been some fixes to FacePoke (automatic conversion of images containing RGBA information), now images such as the one in your original post can be modified properly

@pedrolZasx indeed with your image, FacePoke doesn't work, but I do not have an explanation yet for this case 👀