PatrickHua / SimSiam

A pytorch implementation for paper 'Exploring Simple Siamese Representation Learning'
MIT License
814 stars 135 forks source link

Default settings of gaussian blur described in the paper is unclear #4

Closed PatrickHua closed 3 years ago

PatrickHua commented 3 years ago

Color augmentation is ColorJitter with {brightness, contrast, saturation, hue} strength of {0.4, 0.4, 0.4, 0.1} with an applying probability of 0.8, and RandomGrayscale with an applying probability of 0.2. Blurring augmentation [8] has a Gaussian kernel with std in [0.1, 2.0].

They didn't say the probability of gaussian blur. It's just doesn't make sense to have gaussian blur on both augmentations. Because in training the model only sees blurred images, but in testing, the blury effect is removed. This will definetely hurt the generalization ability of this model. I will use the default gaussian blur probability in simclr instead!