search

WeijingShi / Point-GNN

Point-GNN: Graph Neural Network for 3D Object Detection in a Point Cloud, CVPR 2020.
MIT License
540 stars 112 forks source link

Is Point-GNN suitable for classification and segmentation Task? #33

Open shangguan9191 opened 4 years ago

shangguan9191 commented 4 years ago

Dear Shi,

i am researching methods applying on 3d data, Is Point-GNN suitable for classification and segmentation Task?

WeijingShi commented 4 years ago

Hi @shangguan91, Thanks for your interest. That's an excellent question, we are thinking on that direction as well. Point-GNN's classification header already categorizes each point as the type of the object it belongs to. From this perspective, a segmentation task only needs the classification header to predict point label and we can remove the localization header. Now, the tricky part is the computational cost. A graph with raw point cloud and edges connecting them would be large. The network would be very slow. Currently, we downsample the point cloud to reduce the size of the graph. This is fine with object detection because we can still get a bounding box as long as there are some points on the object. But for segmentation, we want the label for all points. To make it efficient, we probably need to add a "pyramid" structure.