search

city-super / MatrixCity

Apache License 2.0
217 stars 9 forks source link

Inquiry about aerial_street_fusion #35

Closed oungji212 closed 3 months ago

oungji212 commented 3 months ago

Thank you very much for your valuable work!

According to the discussion in issue #30, the ply file for 'aerial_street_fusion' is indicated to be 'Block_small.ply' in the 'small_city_pointcloud/merge' directory. I am attempting to train 3DGS and Octree-GS using the pose(json) and images from 'aerial_street_fusion', alongside 'Block_small.ply'.

However, when rendering using the 'readCamerasFromTransforms' function from Octree-GS (link to function), the rendered images appear empty, with nothing being displayed.

Could you please provide some code or guidance on how to properly initialize 3DGS/Octree-GS with the provided ply file, while using the 'transforms.json' from 'aerial_street_fusion' for training?

Thank you!

jianglh-WHU commented 3 months ago

Well, there's nothing different between matrixcity and other datasets. Load ply using #L120 and load json using #L204. If you have more questions, please feel free to let me know and show some visualized results.

oungji212 commented 3 months ago

After several attempts, I found that changing the existing code:

c2w = np.array(frame["transform_matrix"])
c2w[:3, 1:3] *= -1

to the following:

c2w = np.array(frame["transform_matrix"])
c2w[:3, :] /= 100
c2w[:3, 1:3] *= -1

resolved the issue. Thank you for your reply!