search

ashawkey / stable-dreamfusion

Text-to-3D & Image-to-3D & Mesh Exportation with NeRF + Diffusion.
Apache License 2.0
8.27k stars 728 forks source link

what happens before epoch 10 #150

Open flobotics opened 1 year ago

flobotics commented 1 year ago

Description

When i run the same text-prompt with different settings , the train/loss value before epoch 10 has nearly no big ups/downs , then they start to go up and down. Why is that so ?

Why is the loss increasing while getting better results ? shouldn´t the loss tend to zero ?

tensorboard2

Steps to Reproduce

run the same text-prompt with different settings

Expected Behavior

the train/loss value should directly at start go more up and down, like they do after epoch 10

Environment

win 11

ashawkey commented 1 year ago

Hi, SDS doesn't have an explicit loss value, so the training loss here is just the regularization loss (majorly orientation loss), which only starts to change after 10 epochs (i.e., after the albedo-only training stage, you could change this through --albedo_iters).

xiyufeng2 commented 1 year ago

so loss is changing like this, the train is effective?