Pointcept / SegmentAnything3D

[ICCV'23 Workshop] SAM3D: Segment Anything in 3D Scenes
https://arxiv.org/abs/2306.03908
MIT License
1.01k stars 70 forks source link

2D image number for segment #31

Closed FinnJob closed 1 year ago

FinnJob commented 1 year ago

Thank you for your excellent work! I wonder how many 2D images are required at minimum for segmenting a 3D point cloud? Thanks!

yhyang-myron commented 1 year ago

Thank you for your interest in our work! In ScanNet dataset, we directly use one image every 20 frames in one scene. The number of 2D images for every single scene depends on the total number of frames. We didn't try the relationship between the number of 2D images and segmentation quality.

FinnJob commented 1 year ago

Thank you for your reply! And one more thing. Is it necessary for each frame of the image to be roughly continuous? Would it be feasible to use discretely captured images from different camera positions?

yhyang-myron commented 1 year ago

The images should be as continuous as possible, as we use a bottom-up block merging method. We first merge adjacent images. You may also try to disrupt the order of the images to compare the results.

FinnJob commented 1 year ago

Ok, thanks!