SJoJoK / 3DGStream

[CVPR 2024 Highlight] Official repository for the paper "3DGStream: On-the-fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videos".
https://sjojok.github.io/3dgstream
MIT License
302 stars 18 forks source link

How much time it takes when training the first frame (e.g. t = 0)? #5

Closed gwxxx closed 5 months ago

gwxxx commented 5 months ago

Thanks for your great work! It takes about 12 seconds for per-frame training, but does it also take only 12 seconds for the first frame?

SJoJoK commented 5 months ago

Thanks for your interest in our work! The Initialization (i.e., get the 3dgs of t=0) is a typical 3DGS training and it takes about 10-15 minutes. Therefore, in fact, our training time for each subsequent frame only takes about 9 seconds, but when we calculate the average, we take into account the training time of init_3dgs, so the metric we show in our paper is 12s.

gwxxx commented 5 months ago

Thanks for your interest in our work! The Initialization (i.e., get the 3dgs of t=0) is a typical 3DGS training and it takes about 10-15 minutes. Therefore, in fact, our training time for each subsequent frame only takes about 9 seconds, but when we calculate the average, we take into account the training time of init_3dgs, so the metric we show in our paper is 12s.

Thanks for your reply. I focus on NVS for static scenes, and I wonder are there any 3dgs based method with accelerated training time?

SJoJoK commented 5 months ago

Maybe you can take a look at this work https://github.com/city-super/Scaffold-GS, it converges in shorter time.

gwxxx commented 5 months ago

Maybe you can take a look at this work https://github.com/city-super/Scaffold-GS, it converges in shorter time.

Thanks!

SJoJoK commented 5 months ago

Glad to help:)