VinAIResearch / ISBNet

ISBNet: a 3D Point Cloud Instance Segmentation Network with Instance-aware Sampling and Box-aware Dynamic Convolution (CVPR 2023)
Apache License 2.0
115 stars 23 forks source link

Does the Segmentator require meshes as input? #58

Closed aycatakmaz closed 4 months ago

aycatakmaz commented 4 months ago

Dear authors,

Thank you for this great work!

I have a question regarding the superpoint computation which seems to employ the Segmentator implementation from this repository. If I understand correctly, the function to compute the segments require meshes as input as it relies on the normals and faces. While one can estimate the normals for a point cloud input as well, it seems tricky to obtain a similar estimation for the faces.

Is this possible to run this method on pure point cloud data (for instance from a laser scan) when one does not have access to any mesh reconstruction?

Does this mean that one can run ISBNet only when the reconstructed mesh is available? Similarly, does this imply a similar condition for the follow-up work Open3DIS, which utilizes the super point computation from this repository?

Thank you very much in advance!

Best, Ayca

ngoductuanlhp commented 4 months ago

Hi @aycatakmaz,

For datasets with 3D meshes such as ScanNet, we use the link you mentioned above to generate the superpoints. For datasets without 3D meshes, we utilize the algorithm provided in SPT to calculate the superpoint.

Best.

kaoutar-elmouh commented 4 months ago

Salut@aycatakmaz,

Pour les jeux de données avec des maillages 3D tels que ScanNet, nous utilisons le lien que vous avez mentionné ci-dessus pour générer les superpoints. Pour les ensembles de données sans maillages 3D, nous utilisons l'algorithme fourni dans SPT pour calculer le superpoint.

Meilleur. hello, I have the same question about superpoint generation because I want to do the same with my custom data. Can you tell me which algorithm you use?

aycatakmaz commented 4 months ago

Hi @ngoductuanlhp

Thank you very much for the quick response! This answers my question - I am closing the issue.