hustvl / 4DGaussians

[CVPR 2024] 4D Gaussian Splatting for Real-Time Dynamic Scene Rendering
https://guanjunwu.github.io/4dgs/
Apache License 2.0
2.23k stars 182 forks source link

Merging 4DGS Mismatch Error #165

Open Spawnfile opened 4 months ago

Spawnfile commented 4 months ago

Hello everyone,

I've trained two 4DGS model with different intervals on same dataset and same configs as DyNerf data format. However, on running merging multiple 4dgs models merge_many_4dgs.py throws a mismatch error.

This is how I ran the merging code -> python merge_many_4dgs.py --skip_train --model_path output/interval_1-20/ --configs1 arguments/dynerf/default.py --configs2 arguments/dynerf/default.py --modelpath2 output/interval_21-40/

Besides, as I understand that the merge_many_4dgs.py script, provides a merged/concatenated render that includes both trained model scenes.

Question 1 -> Is there anything wrong on the running section with 2 trained 4DGS ? Question 2 -> Is it true that what merge_many_4dgs.py does as technically ? For my example, I'm expecting a 1-40 (1-20 + 21-40 intervals) interval dynamic GS.

This is the error log and configs I'm using image

image

Cheers