Royalvice / DocDiff

ACM Multimedia 2023: DocDiff: Document Enhancement via Residual Diffusion Models. Also contains 1597 red seals in Chinese scenes, along with their corresponding binary masks.
https://www.aibupt.com/
MIT License
196 stars 21 forks source link

Train with PRE_ORI : 'False' #32

Open mahiratmis opened 4 weeks ago

mahiratmis commented 4 weeks ago

when I train the network with PRE_ORI : 'True' everything looks fine. I tried training the model with PRE_ORI : 'False'. However, during trainig where I save the initial predictions during epochs I observe that initial predictions have some kind of white layer on them. Do you have an idea of why it could be so ? Should it be like that or is something wrong? How can I address the problem ? Any help and feedback is really appreciated.

You can see the attached image for better illustration of the problem. The results are from a batch of images. Left picture is ground truth, middle picture is initial prediction and right picture is (ground truth - inital prediction).

Ekran görüntüsü 2024-06-09 224106

Royalvice commented 4 weeks ago

You're right. When PRE_ORI: 'False', the visualization code during training is incorrect.

mahiratmis commented 4 weeks ago

Would it affect the inference ? If inference uses the results of the initial prediction the inference will also yield in bad results.

mahiratmis commented 3 weeks ago

The inference also produces results with white layer. Can you help adress the problem ?