SIBR reviewer did not work

felixshing commented 2 months ago

Hello, I met some problems when I followed the instructions to try to view the training process. Specifically, I am using "yufeng" dataset, and my training command is python train_splatting_avatar.py --config configs/splatting_avatar.yaml --dat_dir '/home/pc3080/project/3DGS/SplattingAvatar/data/yufeng' To enable SIBR viewer, following README, my command is ./SIBR_remoteGaussian_app --path '/home/pc3080/project/3DGS/SplattingAvatar/data/yufeng/output-splatting/last_checkpoint'. However, it shows this error. I tried multiple --path setup but none of them worked. Could anyone help me with this issue? Thanks!

aistudio2002 commented 2 months ago

I'm facing the same problem, I don't know how to fix this.

initialneil commented 1 month ago

@felixshing @aistudio2002 Please run the original 3dgs on any given data from that repo, and set the path to that output. SIBR_remoteGaussian_app somehow requires a standard 3dgs output of any data to start with.

LuniumLuk commented 2 days ago

I have noticed that when not given standard 3dgs output, the SIBR_remoteGaussian_app will not send a valid camera query to network_gui.py. specifically the message received at https://github.com/initialneil/SplattingAvatar/blob/1b73ee3c283fee3472e2babc8c5d92016ee409cc/gaussian_renderer/network_gui.py#L59 will be sth like:

{'fov_x': 2.8269231770433275e+23, 'fov_y': 1.8492449856613858e+31, 'keep_alive': 1, 'resolution_x': 0, 'resolution_y': 0, 'rot_scale_python': 0, 'scaling_modifier': 1.0, 'shs_python': 0, 'train': 1, 'view_matrix': [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0], 'view_projection_matrix': [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0], 'z_far': 1.8470187487645655e+31, 'z_near': 4.465826379318323e+30}

which finally drop the connection.

initialneil / SplattingAvatar

SIBR reviewer did not work #26