zju3dv / neuralbody

Code for "Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humans" CVPR 2021 best paper candidate
Other
907 stars 130 forks source link

Vertices and Params for custom dataset #127

Closed Dipankar1997161 closed 1 year ago

Dipankar1997161 commented 1 year ago

Hello @pengsida,

You closed the last issue since you said you cannot share the smpl paramaters or camera poses for h36m. Which I totally understand.

  1. Could you tell me the way to get the camera parameters for h36m? Since it is not my dataset, I cannot manually calibrate the intri and extr camera params with a chessboard and then use easy-mocap to receive the yml files (I checked a Chessboard demo on youtube for easymocap)

  2. Will I get those for the vertices and params which are the smpl parameters by simply running the demo.md of easymocap? I don't think so. If possible, could you please link the section or the doc file on EasyMocap from where I can generate the vertices and Params.

  3. Do I need to train h36m on Easymocap to get the smpl params? Because I did not find a training script there.?

I am really sorry for asking these many questions. I have organized the whole dataset just the major ones are missing.

Thank you in advance.

pengsida commented 1 year ago
  1. It provides the camera parameters.
  2. Yes.
  3. No.
Dipankar1997161 commented 1 year ago

Ok, it is clear now. I made the Yml files for the camera parameters of h36m, however, what is the Rotation matrix ( 3 X 1) That is I am not understanding. I added the R(3x3) T(3x1) in extr and then the K and distortion matrix in intri.xml

The intrinsic matrix is usually 3x3, and extrinsic is 4x4 with R|t

But what about the 3x1 R matrix ? Could you clarify that?

Edit: I found that the 3x1 R matrix is the Rodrigues of 3x3 rotation matrix. So I did

rvec = Cv2.Rodrigues(R)[0] I passed the 3x3 Rotation matrix as the input array to it I guess this is correct

Lastly, The translation matrix in the Extrinsic.yml, it is the Original T matrix or again is it the Rodrigues of T matrix?

pengsida commented 1 year ago

The original T matrix.