miraymen / pix2surf

Learning to Transfer Texture from Clothing Images to 3D Humans, CVPR 2020
Other
342 stars 62 forks source link

How to generate texturemaps for other types of garment? #1

Open lonelypicker opened 4 years ago

lonelypicker commented 4 years ago

Hi, Thanks for your great work! I want to generate texturemaps for other types of garment, would it be possible to use this public code? And, how to generate vt_ft_file.pkl for other garment types?

miraymen commented 4 years ago

It should be possible to define a custom garment template using SMPL vertices. To generate vts and fts, we used blender. Please check :https://en.wikibooks.org/wiki/Blender_3D:_Noob_to_Pro/UV_Map_Basics

You will also need to generate face maps and barycentric coordinate maps - fmaps and bmaps.

lonelypicker commented 4 years ago

Sorry to bother you again. How to generate fmaps and bmaps? Are these trained by other networks? And it seems that cam_file.pkl used in prep_data only provide the position of the camara, how to determine the value in cam_file.pkl?

miraymen commented 4 years ago

fmaps and bmaps can be generated using openDR without network training. The values in the cam_fil.pkl are hyper-parameters chosen using randomized grid search. These are values for which the obtained silhouette overlaps with texture silhouettes to a substantial degree.

lonelypicker commented 4 years ago

Thank you very much! Your response helps me a lot!

donghaoye commented 4 years ago

@lonelypicker @aymenmir1 Thanks for your discussions. And how to do it? Any scripts can post?-