search

kcheng1021 / GaussianPro

[ICML2024] Official code for GaussianPro: 3D Gaussian Splatting with Progressive Propagation
https://kcheng1021.github.io/gaussianpro.github.io/
MIT License
551 stars 36 forks source link

Question about waymo data #7

Closed rkdckddnjs9 closed 3 months ago

rkdckddnjs9 commented 3 months ago

Thanks for your excellent works!!

I just have question about waymo!

How can i generate the data format like your drive link? (ex. sky_mask, sparse/0/points3D.ply)

Thanks for reading :)

kcheng1021 commented 3 months ago

Hi, thanks for your attention. sky_mask is generated by SegFormer. points3D.ply is generated during runing GaussianPro. You only need points3D.bin.

rkdckddnjs9 commented 3 months ago

Hi, thanks for your attention. sky_mask is generated by SegFormer. points3D.ply is generated during runing GaussianPro. You only need points3D.bin.

Thanks for your reply!! Was the SegFormer model trained on ADE20K used to create a sky mask? Does "points3D.bin" refer to Structure from Motion (SfM) points?

kcheng1021 commented 3 months ago
  1. I use the segformer.b0.1024x1024.city.160k.pth. Acutally sky mask is not used in training. I just use it to better visualize the depth and normal map.
  2. Yes.
rkdckddnjs9 commented 3 months ago

@kcheng1021 Thanks for your reply :)