Ldhlwh / DFMGAN

[AAAI 2023] Official implementation of "Few-Shot Defect Image Generation via Defect-Aware Feature Manipulation".
https://arxiv.org/abs/2303.02389
Other
87 stars 12 forks source link

One question on result of train #6

Closed hsysfan closed 1 year ago

hsysfan commented 1 year ago

Hello, im a researcher on data augmentation for defect images

I trained your model(DFMGAN) twice for two kind of custom data

First was showing very good result.

But First stage(normal image training) of second data shows some curious results.

The trained model generate rotated image from normal dataset images.

image

Then, i found the augmentation options on training_options.json

There is "rotate90 : 1" on the file.

Can you explain why DFMGAN generates rotated images?

Ldhlwh commented 1 year ago

Hello @hsysfan,

This issue is probably due to the usage of adaptive augmentation in StyleGAN2-ADA. Such rotation is prone to happen when the defect-free dataset is in small quantity or low diversity since the probability of the augmentation will be high trying to counterweight the overfitting.

According to our previous experiments, such rotation will not be happening all the time. You may choose the snapshot at another kimg, try to rerun the training process, or simply turn off the adaptive augmentation if this issue keeps showing up.

CVKim commented 2 months ago

@hsysfan

image

I'm currently in the middle of training, and I noticed that some images are being rotated, which seems to be disrupting the training. I disabled the rotate90 and rotate sections in the code, but the training still isn't going well. The results for the normal images are fine, but the rotated images are causing issues.

Has this issue been resolved?