OceanYing / OmniSeg3D-GS

3D Gaussian Splatting adapted version of OmniSeg3D (CVPR2024)
MIT License
30 stars 2 forks source link

The possibility to use a nerfstudio trained gaussian splat #4

Open abrahamezzeddine opened 1 week ago

abrahamezzeddine commented 1 week ago

Hello,

I am wondering if it is possible to use an already trained nerfstudio splat instead of having to train a gaussian splatting with this model and append/export the semantic segmentation into another splat model or something like that?

Nerfstudio creates a COLMAP structure as well as a finished .ply file.

The splat model has following attributes, which I assume are similar to the original 3DGS model?

ply
format binary_little_endian 1.0
element vertex 2057971
property float x
property float y
property float z
property float nx
property float ny
property float nz
property float f_dc_0
property float f_dc_1
property float f_dc_2
property float f_rest_0
property float f_rest_1
property float f_rest_2
property float f_rest_3
property float f_rest_4
property float f_rest_5
property float f_rest_6
property float f_rest_7
property float f_rest_8
property float f_rest_9
property float f_rest_10
property float f_rest_11
property float f_rest_12
property float f_rest_13
property float f_rest_14
property float f_rest_15
property float f_rest_16
property float f_rest_17
property float f_rest_18
property float f_rest_19
property float f_rest_20
property float f_rest_21
property float f_rest_22
property float f_rest_23
property float f_rest_24
property float f_rest_25
property float f_rest_26
property float f_rest_27
property float f_rest_28
property float f_rest_29
property float f_rest_30
property float f_rest_31
property float f_rest_32
property float f_rest_33
property float f_rest_34
property float f_rest_35
property float f_rest_36
property float f_rest_37
property float f_rest_38
property float f_rest_39
property float f_rest_40
property float f_rest_41
property float f_rest_42
property float f_rest_43
property float f_rest_44
property float opacity
property float scale_0
property float scale_1
property float scale_2
property float rot_0
property float rot_1
property float rot_2
property float rot_3
end_header
OceanYing commented 1 week ago

Sure, it's a good idea. I will try to add this function later to let OmniSeg3D-GS use the available Gaussian splat file.