search

charlesq34 / pointnet

PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
Other
4.64k stars 1.44k forks source link

LiDAR Point Cloud Classification results not good with real data #280

Open manishmaruthi opened 3 years ago

manishmaruthi commented 3 years ago

Dear all,

I am using PointNet to classify LiDAR pointClouds. I have trained the model using ModelNet40 train data(2048 points, 150 epochs) and results are good when I try to classify objects using ModelNet40 test data.

But when I try to classify real data collected by velodyne sensor the prediction is mostly wrong. Please find the attached example. Most of the times I get output as Plant, Guitar or Stairs. I have shifted my objects to center of the coordinate frame and have normalized the values[-1,1]. I have even tried to clean the boundaries.

Can somebody suggest me what I could be doing wrong? Chair_local Person_local

manishmaruthi commented 3 years ago

I found that I have to feed the point cloud in the right orientation or else result can be bad. The network is invariant to geometric transform like rotation only upto an extent