search

city-super / BungeeNeRF

[ECCV22] BungeeNeRF: Progressive Neural Radiance Field for Extreme Multi-scale Scene Rendering
https://city-super.github.io/citynerf
MIT License
570 stars 61 forks source link

How to convert data from GES export #8

Closed FlushingCat closed 2 years ago

FlushingCat commented 2 years ago

Greetings!

I have experimented and reproduced according to the instructions with great results.

But I ran into some problems when using a custom dataset. How should the 3D Camera data extracted from Google Earth Studio be converted into the format used for model training?

I tried to simply pass "rotation" through x'=-x, y'=180-y, z'=180+z to get Euler angles, then convert it to a rotation matrix, and finally combine it with the "position" (after scaling down), but this will cause errors during training and will not get the pose representation in the example dataset

Could you please describe in detail how to convert the data exported from GES?

kam1107 commented 2 years ago

Hi, I newly added a sample script of how we generally convert GES camera data to poses: https://github.com/city-super/BungeeNeRF/blob/main/GES2pose.py

FlushingCat commented 2 years ago

Thanks for your prompt reply！

It really helps me a lot with my current work. I will do further tests to run the model on my custom dataset

lf-191 commented 1 year ago

How you implemented using a custom dataset