Zeqiang-Lai / OpenDMD

Open source implementation and models of One-step Diffusion with Distribution Matching Distillation
GNU General Public License v2.0
94 stars 11 forks source link

【Question】About dmd train #6

Open ApolloRay opened 1 month ago

ApolloRay commented 1 month ago

During the DMD training stage, the loss g and loss d did not drop significantly. Can you provide a loss decline trend during the training process? 截屏2024-05-15 11 59 44 截屏2024-05-15 12 00 06

ApolloRay commented 1 month ago

I use about 25W data (generated by sd1.5) to train the dmd model.

Zeqiang-Lai commented 1 month ago

Unfortunately, the printing log is not saved... This is normal as loss d is mse diffusion loss, it always fluctuates. You could track the training process by looking at the saved val image to see if the quality is improved.

ApolloRay commented 1 month ago

Unfortunately, the printing log is not saved... This is normal as loss d is mse diffusion loss, it always fluctuates. You could track the training process by looking at the saved val image to see if the quality is improved.

Image quality have just improved little. I'm not sure whether the image quality generated by teacher model influence it. I train 70000 steps, generated images are blurred.

ApolloRay commented 1 month ago

Hi, the dreamshaper_8_6k means the gstep=6000 ?How about the batch size and the weight of kl or reg_loss ?

ApolloRay commented 1 month ago

In your train.sh, I found you have sent the reg_loss_weight=0, so the final checkpoints is in this setting ?

ApolloRay commented 1 month ago

I have train the dreamshaper 8 in 170000 steps, but the g_loss and d_loss, always keep in the range(1.34-1.42),(0.12-0.14)

截屏2024-06-04 17 09 18
ApolloRay commented 4 weeks ago

Hope to add your wechat to contact about this model.

Zeqiang-Lai commented 3 weeks ago

Could you provide more visual results you obtained ?

BTW: the official training code of DMD2 is released.

Here are some results obtained from a model I trained before, though the base model is not dreamshaper8.

image
ApolloRay commented 3 weeks ago

Could you provide more visual results you obtained ?

BTW: the official training code of DMD2 is released.

Here are some results obtained from a model I trained before, though the base model is not dreamshaper8.

image

Really cool. I will sort out all the relevant information and inference results of my current training, and I will update it under this issue. I will also take a look at the DMD2 repo.