Open lzg1988 opened 1 year ago
More training and testing data should be used. Perhaps extra experiment are required.
I test on the whole test dataset of SID_Sony with the provided pretrained model 'weights_690000.pth', but the result is not as good as that tested on part of the test dataset. Following is the psnr and ssim I got between the pre_rgb and the gt_rgb.
For reference only.
from https://github.com/TCL-AILab/Abandon_Bayer-Filter_See_in_the_Dark/issues/4
Obviously, we want to figure out whether your work use less testing and training data compare to previous sota in SID dataset?
I tested your pretrained model SID_weights_690000. If testing only 0.1 short exposure data, the psnr and ssim is 29.69 and 0.7962, better than your metrics in paper(29.65, 0.797). However, previous sota method(sid and did) is using the whole test data, including 0.1s, 0.04s and 0.033 shot exposure data. So,we test your model in the same testing data as sid, the metric is much worse. The psnr and ssim is 23.9432 and 0.6831.
Maybe it is not fair to compare the methods by using less testing data.
However, the main issue is that in the table 2 of your paper