facebookresearch / pytorch3d

PyTorch3D is FAIR's library of reusable components for deep learning with 3D data
https://pytorch3d.org/
Other
8.81k stars 1.32k forks source link

10$ to anyone who can help me figure this out! I'm going crazy! Weak perspective camera parameters in pytorch3d #1883

Closed gt732 closed 1 month ago

gt732 commented 1 month ago

Hi,

I'm using PARE to extract SMPL data from a reference video. PARE uses weak camera perspective, I want to render the exact perspective of the original video using the SMPL data.

FROM PARE documentation - https://github.com/mkocabas/PARE pred_cam (n_frames, 3) # weak perspective camera parameters in cropped image space (s,tx,ty) orig_cam (n_frames, 4) # weak perspective camera parameters in original image space (sx,sy,tx,ty)

How can I convert this into pytorch3d camera? I tried for many hours/days but the camera is always incorrect.

image

Ref video frame 1920x1080

image

Any code references you can point me to? This is the last hurdle I'm facing!

Thanks!!

gt732 commented 1 month ago

fixed using mmhuman3d