clovaai / CutMix-PyTorch

Official Pytorch implementation of CutMix regularizer
MIT License
1.22k stars 159 forks source link

question of why cutmix has improved performance. #16

Closed seominseok0429 closed 4 years ago

seominseok0429 commented 4 years ago

hi author.

I'm a student studying deep learning in South Korea.

If look at your paper and the code, it seems like you are cropping random locations, mixing two images and matching two labels.

The question arises here. For example, if there are no objects in an image that is cropped at random locations, label noise may be generated, which may adversely affect performance.

Why does this not adversely affect performance?

hellbell commented 4 years ago

@seominseok0429

The question arises here. For example, if there are no objects in an image that is cropped at random locations, label noise may be generated, which may adversely affect performance. Why does this not adversely affect performance?

In general, when a cropped image has no object at all, the mixing ratio (lambda) will be very small, so it would work as a label noise effect. Also, even though the cropped image doesn't have any object, it has some contexts to classify its class (e.g., a water patch for sea turtle category), and thus we guess this context information boosts classification accuracy.

seominseok0429 commented 4 years ago

친절한 답변 정말 감사합니다!

hellbell commented 4 years ago

@seominseok0429 Thanks :) Closing this issue.