search

fudan-zvg / 4d-gaussian-splatting

[ICLR 2024] Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splatting
MIT License
552 stars 40 forks source link

Reconstruction for urban scenes dataset? #9

Open antithing opened 7 months ago

antithing commented 7 months ago

Hi, thanks for making this code available!

Can you please add instructions for the Reconstruction for urban scenes part of the project page?

What dataset is used? How is it preprocessed?

Thanks!

Alexander0Yang commented 7 months ago

We use the Waymo Open Dataset as mentioned in the Appendix. The required modifications are also provided in this section.

The data processing is referenced from mmdetection3d and S-NeRF.

antithing commented 7 months ago

Thank you for your reply. Are you able to share the config and training workflow for the waymo dataset please?

Do I download:

image

and use python scripts/waymo_preprocess.py from S-Nerf?

antithing commented 7 months ago

Hi @Alexander0Yang sorry to bother you, I am stuck on this! If you can share the exact dataset and provide instructions and config files to replicate the paper results on a waymo dataset I would be very grateful!

Thank you

antithing commented 7 months ago

@Alexander0Yang Okay! i have the dataset prepared, as below, following the mmdetection3d preparation to kitti format.

image

Now I just need the config file, would it be possible to share it here? Thank you very much!

antithing commented 7 months ago

I am still struggling with this. I found the Waymo-mini dataset, but I am lost as to how to process it. A list of steps required would be much appreciated!

rdecharette commented 6 months ago

Hi @antithing, I'm wondering if you've managed to run on Waymo ultimately ? It would be of interest for us.

Best

antithing commented 6 months ago

Unfortunately not, I got stuck. Please post here if anyone solves it!

antithing commented 6 months ago

@Alexander0Yang are you able to help us figure this out? Thank you!

t-martyniuk commented 6 months ago

Hello, @antithing!

As you managed to preprocess the data with mmdetection3d, I wanted to ask you: how much time did the conversion take for you? On my side, I keep running into the issues like the following https://github.com/open-mmlab/mmdetection3d/issues/2371 (there are multiple on their GitHub page), and no suggested solutions seem to work -> the processing moves really slowly.

I would really appreciate if you could share your workarounds if any.

Thanks

antithing commented 6 months ago

Hi, I actually found the mini dataset.

https://download.openmmlab.com/mmdetection3d/data/waymo_mmdet3d_after_1x4/waymo_mini.tar.gz

Which is a subset of the full dataset (and doesn't need the complicated processing)

Now we just need to know how to run it!

CuriousCat-7 commented 4 months ago

Hi, I actually found the mini dataset.

https://download.openmmlab.com/mmdetection3d/data/waymo_mmdet3d_after_1x4/waymo_mini.tar.gz

Which is a subset of the full dataset (and doesn't need the complicated processing)

Now we just need to know how to run it!

Great, have you managed how to run it now?