search

KwaiVGI / LivePortrait

Bring portraits to life!
https://liveportrait.github.io
Other
11k stars 1.11k forks source link

0/24 image face detected #108

Open jonlepage opened 1 month ago

jonlepage commented 1 month ago

not work with anime or toon ... ex: image image

cleardusk commented 1 month ago

One way to handle this is to manually crop the source image, and disable auto-cropping : )

fhdrheh12 commented 1 month ago

I went through the same experience. They say that face recognition is not possible even if you proceed with an image with just a cut of the face.

(anime images) aaa1 aaaa22 ccc1q1

Tom-Neverwinter commented 1 month ago

I always try the "pumpkin test" on these and sadly it fails. I take a handful of pumpkins to see how it recognizes a face

NineMeowICT commented 1 month ago

@cleardusk Is it possible to use YOLO to detect faces instead of Insightface

UPDATE: Error is raised even after I disabled auto cropping: Traceback (most recent call last): File "/media/ninemeow/Delta/LivePortrait/inference.py", line 59, in main() File "/media/ninemeow/Delta/LivePortrait/inference.py", line 55, in main live_portrait_pipeline.execute(args) File "/media/ninemeow/Delta/LivePortrait/src/live_portrait_pipeline.py", line 117, in execute driving_lmk_crop_lst = self.cropper.calc_lmks_from_cropped_video(driving_rgb_lst) File "/media/ninemeow/Delta/LivePortrait/src/utils/cropper.py", line 197, in calc_lmks_from_cropped_video raise Exception(f"No face detected in the frame #{idx}") Exception: No face detected in the frame #0

cleardusk commented 1 month ago

It seems that X-Pose generalizes to animals, anime, etc, https://github.com/KwaiVGI/LivePortrait/issues/119#issue-2404870592 @NineMeowICT : )

NineMeowICT commented 1 month ago

@cleardusk Thanks. I will give it a try.

jonlepage commented 1 month ago

i think also alpha background make issu