Pointcept / SegmentAnything3D

[ICCV'23 Workshop] SAM3D: Segment Anything in 3D Scenes
https://arxiv.org/abs/2306.03908
MIT License
1.01k stars 70 forks source link

Add scripts for point cloud data captured from 3d scanner app #47

Closed a1091150 closed 7 months ago

a1091150 commented 7 months ago

Point cloud data can be captured from 3D scanner app. This app exports necessary files to SAM3D.

Follow the steps to capture and test:

  1. In 3d scanner app, there are five options to catpure data from the sensor. Choose the second option to capture point.
  2. After captured, export all data to your computer. The directory should contain frame_XXX.jpg(s), frame_XXX.json(s), depth_XXX.png(s) and points.ply. The number of frame_XXX.jpg(s) are usually less than frame_XXX.json(s').
  3. Use preprocess_3d_scan.py to preprocess the files. This will generate a directory including points.pth, color directory, depth directory, pose directory and intrinsics directory.
  4. Use sam3d_custom.py to run. This will generate a directory, 2d mask images, result.pth, result.ply.