search

facebookresearch / DensePose

A real-time approach for mapping all human pixels of 2D RGB images to a 3D surface-based model of the body
http://densepose.org
Other
6.97k stars 1.3k forks source link

How to correspond to the point of a specific pose with SMPL model #178

Open kotomiDu opened 5 years ago

kotomiDu commented 5 years ago

As mentioned in Densepose, they do annotations and get UV coordinates with SMPL model. But what I see in the visualization of SMLP model is a template without any pose. What is the meaning of get such UV points? Do these UV points include any pose information or 3D information?

kotomiDu commented 5 years ago

get some idea from https://github.com/davidleejy/DensePose/blob/speedup/notebooks/DensePose-Fast-IUV-2-XYZ.ipynb

But what is I (in IUV) represent?

vkhalidov commented 5 years ago

I is the part index or 0 = background

kotomiDu commented 5 years ago

I is the part index or 0 = background

Thanks. I see

kotomiDu commented 5 years ago

I is the part index or 0 = background

@vkhalidov BTW, I can understand the different color in the I image representing different part. How about the U V images? What's the meaning of these different colors ?

vkhalidov commented 5 years ago

U ∈ [0, 1] and V ∈ [0, 1] are point coordinates within those parts. The coordinates are depicted schematically in this notebook

kotomiDu commented 5 years ago

U ∈ [0, 1] and V ∈ [0, 1] are point coordinates within those parts. The coordinates are depicted schematically in this notebook

@vkhalidov As it mentioned in this notebook, dp_x, dp_y' represent the spatial coordinates of collected points. Is it right that each value of dp_x/dp_y are related to one color? If that is true, I am confused why the color is different even though the points have same dp_x value?

vkhalidov commented 5 years ago

@kotomiDu Could you please provide details on which visualization you refer to?

kotomiDu commented 5 years ago

@kotomiDu Could you please provide details on which visualization you refer to?

@vkhalidov what I refer to is the visualization at the end of this page. I clearly understand the visualization of patch indices. But for the u and v cooridnates, I can't find any encoding rule. Is it right that each value of dp_x/dp_y are related to one color? If that is true, I am confused why the color is different even though the points have same dp_x value?