facebookresearch / pytorch3d

PyTorch3D is FAIR's library of reusable components for deep learning with 3D data
https://pytorch3d.org/
Other
8.75k stars 1.31k forks source link

Octree Data Structure Support #393

Open aradhyamathur opened 4 years ago

aradhyamathur commented 4 years ago

🚀 Feature

Support for Octrees based neural networks

Motivation

Recently several research works by Wang et al. have proposed Octree-Based CNNs for various shape analysis tasks. A similar feature implementation that allows the operations over octrees could be of great benefit especially due to the reduced memory footprint that octrees allow for 3D data.

Pitch

The current implementation exists in tensorflow only given here. It would great if pytorch3d too has similar features to allow the creation of octree based neural networks. Would be glad to contribute.

gkioxari commented 4 years ago

This sounds like a great suggestion! We will discuss this with our team and will comment here for a timeline.

albertotono commented 3 years ago

It seems that two days after this conversation they added support for pytorch https://github.com/microsoft/O-CNN/tree/master/pytorch pretty efficient

aradhyamathur commented 3 years ago

Yeah but I guess it will be better to have this data structure in pytorch3D as well, to allow some more flexibility to users to use octrees.

albertotono commented 3 years ago

They also confirmed that it is still under development.