search

shunsukesaito / PIFu

This repository contains the code for the paper "PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization"
https://shunsukesaito.github.io/PIFu/
Other
1.75k stars 342 forks source link

z-feature for perspective camera model #73

Closed yangze0930 closed 3 years ago

yangze0930 commented 3 years ago

Hi Shunsuke,

thanks for your great work. If I want to train the model with perspective camera model, what do you think is a good z-feature? I have tried to use the z-feature as the depth of human pelvis minus the depth of sample point in camera coordinate system, in this way we ensure the pelvis centers are aligned across data sample, but the result is still not good enough compared to using orthographic camera model. As shown in the attached image, it struggles at figuring out depth at foot. Do you have some suggestions? Thanks for your reply!

Best, Ze

Screen Shot 2020-09-16 at 9 50 04 PM Screen Shot 2020-09-16 at 9 49 55 PM

shunsukesaito commented 3 years ago

As you mentioned, probably simply normalizing depth by pelvis does not fully resolve the problem. There are recent followup works that attempt to address the issue. You can probably check them out. https://arxiv.org/abs/2006.08072 https://arxiv.org/abs/2007.03858 https://arxiv.org/abs/2004.04572

yangze0930 commented 3 years ago

Hi @shunsukesaito, thanks for your reference.