search

keyu-tian / SparK

[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"
https://arxiv.org/abs/2301.03580
MIT License
1.41k stars 82 forks source link

Pretrained weights on ResNet18? #42

Open shuuchen opened 1 year ago

shuuchen commented 1 year ago

Hi,

Thanks so much for your great work! I wonder if you can publish the pretrained weights on ResNet18 for restricted memory?

Thnak you!

keyu-tian commented 1 year ago

We'd like to do this, but currently don't get enough GPU resources. We will do this later and let you know once it published.