search

city-super / Scaffold-GS

[CVPR 2024 Highlight] Scaffold-GS: Structured 3D Gaussians for View-Adaptive Rendering
https://city-super.github.io/scaffold-gs
Other
756 stars 65 forks source link

SIBR Viewer connection constantly dropping #73

Open EarltShirt opened 2 months ago

EarltShirt commented 2 months ago

When using the given SIBR Viewer executable on Windows 10 + cuda 11.6, the remote gaussian app works well, but as soon as I added feature embedding and an appearance_dim > 0 the connection constantly drops even if the connection works, leaving me with a black window in the SIBRViewer app. I really don't know why this happens, the port and ip are the same as when the remote viewer worked..

This is the one I use : ./SIBR_viewers/bin/SIBR_remoteGaussian_app.exe and here is part of my output log :

./SIBR_viewers/bin/SIBR_remoteGaussian_app.exe  
[SIBR] --  INFOS  --:   Initialization of GLFW
[SIBR] --  INFOS  --:   OpenGL Version: 4.6.0 NVIDIA 556.12[major: 4, minor: 6]
[SIBR] --  INFOS  --:   Trying to connect...
[SIBR] --  INFOS  --:   Connected!
[SIBR] --  INFOS  --:   Dataset type: 
Number of input Images to read: 180
Number of Cameras set up: 180
LOADSFM: Try to open \repos\scaffold_ur\data\colmap\0/sparse/0/points3D.bin
Num 3D pts 5201
[SIBR] --  INFOS  --:   SfM Mesh '\repos\scaffold_ur\data\colmap\0/sparse/0/points3d.bin successfully loaded.  (5201) vertices detected. Init GL ...
[SIBR] --  INFOS  --:   Init GL mesh complete 
[SIBR] --  INFOS  --:   Initializing Raycaster
[SIBR] --  INFOS  --:   Interactive camera using (0.009,1100) near/far planes.Switched to trackball mode.
[SIBR] --  INFOS  --:   Connection dropped  
[SIBR] --  INFOS  --:   Trying to connect...
[SIBR] --  INFOS  --:   Connected!
[SIBR] --  INFOS  --:   Connection dropped  
[SIBR] --  INFOS  --:   Trying to connect...
[SIBR] --  INFOS  --:   Connected!        
[SIBR] --  INFOS  --:   Connection dropped
[SIBR] --  INFOS  --:   Trying to connect...
[SIBR] --  INFOS  --:   Connected!
[SIBR] --  INFOS  --:   Connection dropped
[SIBR] --  INFOS  --:   Trying to connect...
[SIBR] --  INFOS  --:   Connected!
[SIBR] --  INFOS  --:   Connection dropped
[SIBR] --  INFOS  --:   Trying to connect...
[SIBR] --  INFOS  --:   Connected!
[SIBR] --  INFOS  --:   Connection dropped
[SIBR] --  INFOS  --:   Trying to connect...
[SIBR] --  INFOS  --:   Connected!
[SIBR] --  INFOS  --:   Deinitialization of GLFW

And the output in the training bash is :

Training progress:  48%|████████         | 14260/30000 [26:16<28:37,  9.16it/s, Loss=0.0115185, Angle=6.75]
Connected by ('127.0.0.1', 57223) [07/08 13:50:56]

Connected by ('127.0.0.1', 57224) [07/08 13:50:56]

Connected by ('127.0.0.1', 57225) [07/08 13:50:56]

Connected by ('127.0.0.1', 57226) [07/08 13:50:56]

Connected by ('127.0.0.1', 57227) [07/08 13:50:56]

Connected by ('127.0.0.1', 57228) [07/08 13:50:56]

Connected by ('127.0.0.1', 57229) [07/08 13:50:56]

Connected by ('127.0.0.1', 57230) [07/08 13:50:56]

Connected by ('127.0.0.1', 57231) [07/08 13:50:57]
tongji-rkr commented 1 month ago

In fact, we did not modify the remote viewer for adaptation, and we will consider this issue in the viewer of future work.