YuliangXiu / ICON

[CVPR'22] ICON: Implicit Clothed humans Obtained from Normals
https://icon.is.tue.mpg.de
Other
1.6k stars 219 forks source link

pifu code #219

Closed z-z-zhao closed 1 year ago

z-z-zhao commented 1 year ago

您好,我看了您的ICON的仓库,其中关于PIFu的代码。我有了一些疑问,在2019年的PIFu论文中并没有使用法线的特征,为什么关于PIFu的您的代码中有法线的使用? 法线? 另外您还使用了smpl的特征?(PIFu论文中并没有使用smpl)如下图:

其他特征 恳请您帮助解决我的疑问!十分感谢!!!

z-z-zhao commented 1 year ago

2019年的PIFu(https://github.com/shunsukesaito/PIFu)

z-z-zhao commented 1 year ago

PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization

YuliangXiu commented 1 year ago

In my re-implemented PIFu, called PIFu* in ICON's paper:

z-z-zhao commented 1 year ago

in your "But PIFu does not extract local features from SMPL (please go deeper into HGPIFuNet.py#L126), it only uses image+normal as input". is PIFu(your code) or PIFu (original paper) ?

As far as I know, PIFu* (original paper) did not use normals and it just use image,but PIFuHD used forward and backward normals + image. This is very important to me and I look forward to your reply!

YuliangXiu commented 1 year ago

Sorry for the confusion, I updated the last reply, PIFu* is from ICON's paper.

PIFu (original): use image as input PIFuHD: use image+normals(front+back, estimated from image) as input PIFu* (ICON's re-implementation): use image+normals(front+back, estimated from image & conditioned on SMPL-X) as input