google-research / nested-transformer

Nested Hierarchical Transformer https://arxiv.org/pdf/2105.12723.pdf
Apache License 2.0
190 stars 26 forks source link

About swintransformer ON cifar #3

Closed ygdr2020 closed 3 years ago

ygdr2020 commented 3 years ago

could you share your patch size and window size when you run swin on CIFAR

zizhaozhang commented 3 years ago

We compared combinations of patch size = [1, 2] and window size = [2, 4] and found patch size = 1 and window size = 2 works best and use this to report.

ygdr2020 commented 3 years ago

thanks