hustvl / 4DGaussians

[CVPR 2024] 4D Gaussian Splatting for Real-Time Dynamic Scene Rendering
https://guanjunwu.github.io/4dgs/
Apache License 2.0
2.26k stars 189 forks source link

How to Create custom dataSets for training? #46

Closed chongxian closed 9 months ago

chongxian commented 11 months ago

Hello, I have gone through the entire issues and I have a lot of doubts about how to build my own dataset. I have successfully compiled NerfStudio, but it can only generate data in colmap format and cannot convert it to Blender format. Additionally, the Readme does not provide instructions on how to train a generic dataset. I would greatly appreciate it if you could provide me with a solution.

guanjunwu commented 11 months ago

In the code lib of 4D-GS, colmap format also can be trained. You can check the details of the code.

leo-frank commented 11 months ago

In the function readColmapCameras, i find that the time is always set to 0.

Does this have an influence on training ?

guanjunwu commented 11 months ago

In the function readColmapCameras, i find that the time is always set to 0.

Does this have an influence on training ?

Oh, sorry, that's a bug. This is a new PR, maybe this can work?

leo-frank commented 11 months ago

I think this PR is correct.

leo-frank commented 11 months ago

But i am not sure about: whether if issue #35 (Loss become Nan after some time training) has relation with this bug ?

guanjunwu commented 9 months ago

Hi, I think there are no relation. If you have any question about custom datasets, you can reopen the issue.