Bureau - Hotel de la Marine - H100

1. Training using train.py (calls the scrips automatically)

1.1 Align cameras using COLMAP implementation of GS

python gaussian_splatting/convert.py -s data/Bureau/

1.2 Train GS model

python gaussian_splatting/train.py -s data/Bureau_sdf_low_poly/ --iterations 7000 -m outputs_GS/Bureau

Train the Sugar model

python train.py -s data/Bureau_sdf_low_poly/ -c outputs_GS/Bureau/ -r "sdf" --low_poly True

we obtain a lot of background elements

2. Running separate scripts

2.1 extract_mesh.py

I use the coarse Sugar model already optimized
to remove background contribution in the mesh, I rescale bg_bbox_factor from 4 to 1 (as for angel and statues), in extract_mesh_from_coarse_sugar() in sugar_extractors/coarse_mesh.py

    # Mesh computation parameters
    fg_bbox_factor = 1.  # 1.
    bg_bbox_factor = 1.  # 4.
    poisson_depth = 10  # 10
    decimate_mesh = True
    clean_mesh = True

I then extract the coarse mesh (without running the coarse model) as the bg_bbox_factor is only present in the extract_mesh.py

python extract_mesh.py -s data/Bureau_sdf_low_poly_bgfactor_1/ -c outputs_GS/Bureau/ -i 7000 -m output/coarse/Bureau_sdf_low_poly/sugarcoarse_3Dgs7000_sdfestim02_sdfnorm02/15000.pt -l 0.3 -d 200000 -o output/coarse_mesh

2.2 train_refined.py

Then we need to refined this coarse mesh using train_refined.py (keeping the total number of vertices -v 200000).

python train_refined.py -s data/Bureau_sdf_low_poly_bgfactor_1/ -c outputs_GS/Bureau/ -i 7000 -m output/coarse_mesh/Bureau_sdf_low_poly_bgfactor_1/sugarmesh_3Dgs7000_sdfestim02_sdfnorm02_level03_decim200000.ply -o output/refined/Bureau_sdf_low_poly_bgfactor_1/ -v 200000

2.3 extract_refined_mesh_with_texture.py

python extract_refined_mesh_with_texture.py -s data/Bureau_sdf_low_poly_bgfactor_1/ -c outputs_GS/Bureau/ -i 7000 -m output/refined/Bureau_sdf_low_poly_bgfactor_1/sugarfine_3Dgs7000_sdfestim02_sdfnorm02_level03_decim200000_normalconsistency01_gaussperface1/15000.pt -o output/refined_mesh/Bureau_sdf_low_poly_bgfactor_1

Lay3rss / SuGaR