search

USTC-JialunPeng / Diverse-Structure-Inpainting

CVPR 2021: "Generating Diverse Structure for Image Inpainting With Hierarchical VQ-VAE"
MIT License
175 stars 19 forks source link

commit loss is so big #15

Closed df720 closed 2 years ago

df720 commented 2 years ago

is this normal?

USTC-JialunPeng commented 2 years ago

The commitment loss is about 1e-3~1e-2 in the training of VQ-VAE. How big is your commitment loss?

df720 commented 2 years ago

About 50-1000.Here is my result in the training, the current step is 20000. I use the environment of tensorflow2.

USTC-JialunPeng commented 2 years ago

I didn't train our code on TensorFlow2. I'm sure it's not normal for your commitment loss. The normal one should be above 1e-2 at the beginning of training (100 steps).

df720 commented 2 years ago

Ok, thanks!