search

google-research / vision_transformer

Apache License 2.0
10.45k stars 1.29k forks source link

Is there any plan to release the code of masked patch prediction? #103

Open mathfinder opened 3 years ago

mathfinder commented 3 years ago

Thx for the fancy work. I wonder is there any plan to release the code of masked patch prediction. I am very interested in the detail of the training. For example, is there any data augmentation for the training?

andsteing commented 3 years ago

Hi,

we don't plan to release that code. As for your first question, we trained on JFT and used the same data augmentation as for classification (random flip & inception_crop to 224 pixels).