threestudio-project / threestudio

A unified framework for 3D content generation.
Apache License 2.0
6.18k stars 474 forks source link

Prolific stage1 get weird color with large steps? #256

Closed krNeko9t closed 1 year ago

krNeko9t commented 1 year ago

using prolificdreamer-patch.yaml to launch the program with 25000 total steps. and before step 5600 it's fine. but after 8000, the result color breaks. And It seems happen is the latter steps no matter how many total steps it is (e.g. total 10000, then break in 4000 maybe) I guess it's maybe the hyperparameter? I lower the lambda_sparsity and the break show up a bit latter. Example are here: it5600-0 it8000-0

thuliu-yt16 commented 1 year ago

This problem does exist in some cases, mostly due to the annealing strategy (t~[0.02,0.98] -> [0.02, 0.5]). This may be a point for improvement, such as a better annealing strategy. You can try to increase the lower bound. I am not sure whether some recent works can improve it, e.g. TP-SDS.

ARuiChen commented 1 year ago

The time step range of [0.02, 0.5] may produce strange colors in some cases.