NVlabs / RVT

Official Code for RVT-2 and RVT
https://robotic-view-transformer-2.github.io/
Other
261 stars 31 forks source link

Use RVT-2 without pytorch3d? #46

Closed Walter0807 closed 2 months ago

Walter0807 commented 2 months ago

The readme says that "You can skip this step if you only want to use RVT-2 as it uses our custom Point-Renderer for rendering. PyTorch3D is required for RVT." However, I found that it is still used (for example here). Is it possible to bypass pytorch3d for RVT-2?

imankgoyal commented 2 months ago

Hi @Walter0807,

That's a good point. The augmentation function still uses some utils from PyTorch3D, so the current code bypasses only its rendering functionality. If you want to bypass it altogether, the util functions could be replaced by similar ones from Scipy (more info here). I would be happy to merge any updates if you create one.

Best, Ankit

Walter0807 commented 2 months ago

Thanks for your reply! I managed to install PyTorch3D for backward compatibility.