search

lucidrains / perceiver-pytorch

Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch
MIT License
1.1k stars 133 forks source link

Pretrained model weights #30

Open philippschw opened 3 years ago

philippschw commented 3 years ago

Thank you for sharing @lucidrains ! Really fantastic work. I watched Yanniks video on perceiver and this repo really helps to go one or two levels deeper and understand the paper. However, for applying this new architecture to practical applications, most of us without 100s of TPUs at our disposal, require pretrained models on imagenet, audioset etc. Could anyone that has successfully trained the model, can share weights?

Jogima-cyber commented 3 years ago

Would be glad to have some weights for audio tasks as well!

m3at commented 3 years ago

Same as #34 you can find some pre-trained weights in the author's repo: https://github.com/deepmind/deepmind-research/tree/master/perceiver#colabs