VITA-Group / EnlightenGAN

[IEEE TIP] "EnlightenGAN: Deep Light Enhancement without Paired Supervision" by Yifan Jiang, Xinyu Gong, Ding Liu, Yu Cheng, Chen Fang, Xiaohui Shen, Jianchao Yang, Pan Zhou, Zhangyang Wang
Other
890 stars 198 forks source link

Unable to reproduce EnlightenGAN-N #42

Closed russelltankl closed 4 years ago

russelltankl commented 4 years ago

Hi,

I followed your steps in your paper to reproduce EnlightenGAN-N but with no avail. From my understanding, I just need to swap the training data with BDD-100k low-light images (mean pixel intensity values smaller than 45). Other parameters such as 200 epoch and normal light images remain the same.

Please let me know what am I missing here.

Thanks

yifanjiang19 commented 4 years ago

You should upload some results then I can help debug

russelltankl commented 4 years ago

My apologies for taking so long to reply. Here are a few sample images I have. The results of enhancement from my end have a lot of artifacts around light sources.

Capture

Capture

Capture

yifanjiang19 commented 4 years ago

Do you use the dark dataset in BDD-100k and bright dataset from what I provided?

russelltankl commented 4 years ago

Yes I did for both. More specifically I used images from BDD-100k that are labeled as "night" in the labels.

Do you know what is causing this artifact, or how to move forward from here to troubleshoot the problem?

zhangxiaopang88 commented 4 years ago

我也用bdd-100k数据集去训练,我想问您说低亮度数据集使用自己的,正常光数据集使用您提供的1016张图片,那我自己低亮度的数据个数有限制吗,对低亮度的图片还有其他要求吗?非常期待您 的回复 @yueruchen

yifanjiang19 commented 4 years ago

I'm really busy over the last month. Have you solved the problems? @zhangxiaopang88 @russelltankl

yifanjiang19 commented 4 years ago

@zhangxiaopang88 If you want to use your own dataset, you should confirm that 1) the dataset you prepared is not extremely dark, which is not suitable in our case due to severe noise. 2) prepare ~1000 data should be enough

russelltankl commented 4 years ago

@yueruchen I have not solved it yet. Currently, I'm not sure how to proceed

yifanjiang19 commented 4 years ago

Could you please slightly enlarge the self_feature_preserving_loss --vgg ? Normally we use gan loss and vgg loss to balance the brightness and naturalness. Seems that your results show that you make it too much bright, so you should increase the --vgg loss weight.