threestudio-project / threestudio

A unified framework for 3D content generation.
Apache License 2.0
6.32k stars 480 forks source link

Degenerate results with `sd-turbo` #365

Open jon-chuang opened 11 months ago

jon-chuang commented 11 months ago

Running magic3d with sd-turbo yields degenerate results; the image becomes discolored.

Maybe this is just a scheduler/CFG problem. Further, shouldn't sd-turbo have a clearer signal to sd-2.1 and converge in fewer iterations? :thinking:

iteration 1800 it1800-0

iteration 4000 it4000-0

DSaurus commented 11 months ago

Hi, @jon-chuang

That's interesting. I think it is a CFG problem. Also, the gradient of sd-turbo may be too large, which causes instability in 3D generation.