dancasas / SMPLitex

SMPLitex – Official implementation
92 stars 7 forks source link

image to complete uv map with smplitex #2

Closed zhenzhiwang closed 8 months ago

zhenzhiwang commented 9 months ago

Hi, Thanks for sharing your great work!

I notice that the scripts in readme has only text2image.py and inpaint.py. It seems that if I want to estimate complete uv map from a single image, I need to first use other methods to extract incomplete uv map and mask. Is it right? I want to know is there any existing pipeline to estimate incomplete uv map from a single image and then make the uv map complete with smplitex? Just like the teaser figure in your repo shows, from a human image to a complete uv map. Looking forward to your reply!

Screenshot 2024-01-02 at 12 34 21
dancasas commented 9 months ago

Hi, yes we are still working on releasing the script to project image pixels into incomplete texturemap. It basically runs densepose on the input image and uses the IUV predictions to populate the texturemap using the original pixel values. I will try to push the script in the next few days.

StGorazd commented 9 months ago

Hi, I am also interested in this step of pipeline do you have any update on it?

dancasas commented 8 months ago

Hi, I'm working on releasing the script to create the partial texturemaps, will be released in few days.

dancasas commented 8 months ago

Hello @StGorazd and @zhenzhiwang , I've updated the repository with the scripts to create the partial texturemap from image, and the inpainting with Automatic1111.

https://github.com/dancasas/SMPLitex?tab=readme-ov-file#smpl-texture-estimation-from-single-image

Please, check it out and let me know. Thanks!