gsgen3d / gsgen

[CVPR 2024] Text-to-3D using Gaussian Splatting
https://arxiv.org/abs/2309.16585
MIT License
761 stars 42 forks source link

Still occurs severe Janus problem #43

Open jimmychuang95 opened 2 months ago

jimmychuang95 commented 2 months ago

After install gsgen and run with command

python main.py --config-name=base prompt.prompt="a cute corgi"

here is what I got

image

and below is my run summary, why there's still some severe Janus problem?

Run summary:
wandb:               auxiliary/total 0.0
wandb:              data/azimuth_max 90.0
wandb:              data/azimuth_min -90.0
wandb:            data/elevation_max 90.0
wandb:            data/elevation_min -20.0
wandb:                data/focal_max 1.35
wandb:                data/focal_min 0.75
wandb:                     data/reso 512.0
wandb:                   global_step 0
wandb:             guidance/max_step 500.0
wandb:             guidance/min_step 20.0
wandb:                      loss/sds 14181.02441
wandb:                    loss/total 1418.10242
wandb:              loss_weights/sds 0.1
wandb:                      lr/alpha 0.003
wandb:                         lr/bg 0.003
wandb:                      lr/color 0.01
wandb:                       lr/mean 3e-05
wandb:                       lr/qvec 0.003
wandb:                       lr/svec 0.001
wandb:       renderer/alpha/grad_max 0.47007
wandb:       renderer/alpha/grad_min 0.0
wandb:            renderer/alpha/max 0.99894
wandb:           renderer/alpha/mean 0.7428
wandb:            renderer/alpha/min 0.00393
wandb:       renderer/color/grad_max 0.636
wandb:       renderer/color/grad_min 0.0
wandb:            renderer/color/max 1.0
wandb:           renderer/color/mean 0.55208
wandb:            renderer/color/min 0.0
wandb:        renderer/mean/grad_max 406.59451
wandb:        renderer/mean/grad_min 0.0
wandb:             renderer/mean/max 1.39963
wandb:            renderer/mean/mean 0.02452
wandb:             renderer/mean/min 0.0
wandb: renderer/n_gaussians_with_dub 707780.0
wandb:        renderer/num_gaussians 249447.0
wandb:        renderer/qvec/grad_max 12.67941
wandb:        renderer/qvec/grad_min 0.0
wandb:             renderer/qvec/max 2.72277
wandb:            renderer/qvec/mean 0.22615
wandb:             renderer/qvec/min 0.0
wandb:        renderer/svec/grad_max 6.686
wandb:        renderer/svec/grad_min 0.0
wandb:             renderer/svec/max 0.04836
wandb:            renderer/svec/mean 0.01166
wandb:             renderer/svec/min 0.00083