fofr / cog-consistent-character

Create images of a given character in different poses
https://replicate.com/fofr/consistent-character
MIT License
459 stars 40 forks source link

doesn't seem to work for comic character kind of subject images #4

Open biswaroop1547 opened 3 weeks ago

biswaroop1547 commented 3 weeks ago

thanks! @fofr for this project! 🙏🏻

is there any alternative for antelopv2? https://github.com/deepinsight/insightface/issues/2560 using instantid to extract key points of faces but performs poorly with comic character like humanoids as I keep getting no faces detected Here are some example subject images with which I am not able to make it work:

ComfyUI_temp_ihpsb_00069_ (1) 00022-2605090199

andyg2 commented 1 week ago

There are probably better much solutions out there but when I can't push a models any further and in a pinch I've had some success with overlaying a human faces and increasing the opacity until it works. The example attached is 33% so it's very visible (for demonstration) but as little 1% opacity can be enough to tip the models in the right direction. For this I simply align in photoshop and smudged the nose into position. I didn't bother with the eyebrows but you would want to do that.

image