Is there a way to use my own images in "Fit a mesh via rendering"?

facebookresearch / pytorch3d

PyTorch3D is FAIR's library of reusable components for deep learning with 3D data

https://pytorch3d.org/

Other

8.7k stars 1.3k forks source link

Is there a way to use my own images in "Fit a mesh via rendering"? #1705

Closed hadillivvy closed 9 months ago

hadillivvy commented 9 months ago

I ran the demo provided in the collab (https://pytorch3d.org/tutorials/fit_textured_mesh) to fit a mesh to images rendered from an input mesh but I want to fit a mesh by providing it my own images (not rendered from a mesh). Is that possible using pytorch3d? I have a way of getting the camera's rotation (R) and translation (T) but I'm not sure how to change the code so that it takes my own images and get silhouette based on these images. Can anyone help?

bottler commented 9 months ago

I think you need to work through the tutorial making sure you understand every step. You'll need to construct target_images and target_rgb from your own images and change a few other things.