search

lucidrains / bottleneck-transformer-pytorch

Implementation of Bottleneck Transformer in Pytorch
MIT License
671 stars 82 forks source link

pretrained models? #1

Closed oukohou closed 7 months ago

oukohou commented 3 years ago

Great work! Are the pretrained models availabel?

amiltonwong commented 3 years ago

I don't think so. It's mentioned that TPU x 3 were used in the original paper. Just wait for the official release of the pretrained model :P

BIGBALLON commented 3 years ago

Great work! Are the pretrained models availabel?

A pytorch version: https://github.com/BIGBALLON/distribuuuu/blob/master/distribuuuu/models/botnet.py,

The results (the model trained by distribuuuu) :

model epoch total batch lr policy base lr Acc@1 Acc@5 model / config
resnet18 100 256 (32*8GPUs) cos 0.2 70.902 89.894 Google Drive / cfg
resnet18 100 1024 (128*8GPUs) cos 0.8 70.994 89.892
resnet18 100 8192 (128*64GPUs) cos 6.4 70.165 89.374
resnet18 100 16384 (256*64GPUs) cos 12.8 68.766 88.381
resnet50 100 256 (32*8GPUs) cos 0.2 77.252 93.430 Google Drive / cfg
botnet50 100 256 (32*8GPUs) cos 0.2 77.604 93.682 Google Drive / cfg

Training log: https://gist.github.com/BIGBALLON/3d53c81b2b11ea5dd66417c2a985cd89

@oukohou

oukohou commented 3 years ago

@BIGBALLON yeah thanks for your work! I will try that later.Great thanks again.

biki18 commented 2 years ago

Great work! Are the pretrained models availabel?

A pytorch version: https://github.com/BIGBALLON/distribuuuu/blob/master/distribuuuu/models/botnet.py,

The results (the model trained by distribuuuu) :

model epoch total batch lr policy base lr Acc@1 Acc@5 model / config resnet18 100 256 (328GPUs) cos 0.2 70.902 89.894 Google Drive / cfg resnet18 100 1024 (1288GPUs) cos 0.8 70.994 89.892
resnet18 100 8192 (12864GPUs) cos 6.4 70.165 89.374
resnet18 100 16384 (25664GPUs) cos 12.8 68.766 88.381
resnet50 100 256 (328GPUs) cos 0.2 77.252 93.430 Google Drive / cfg botnet50 100 256 (328GPUs) cos 0.2 77.604 93.682 Google Drive / cfg Training log: https://gist.github.com/BIGBALLON/3d53c81b2b11ea5dd66417c2a985cd89

@oukohou

Hi, You really did a great job. But I am having some problems with your pre-trained model. I would like to ask how should I use botnet50.pth. I found no state_dict in it to load when I tried to run it. Then I tried to unzip it and only found a data.pkl file. And when I tried to load it, I got an error: _pickle.UnpicklingError: A load persistent id instruction was encountered. @BIGBALLON

xiaoWen9246 commented 1 year ago

@BIGBALLON when I open the botnet50' model Hyperlink, Google Drive indicates that the file doesn't exist.

rookiiiie commented 1 year ago

Great work! Are the pretrained models availabel?

A pytorch version: https://github.com/BIGBALLON/distribuuuu/blob/master/distribuuuu/models/botnet.py,

The results (the model trained by distribuuuu) :

model epoch total batch lr policy base lr Acc@1 Acc@5 model / config resnet18 100 256 (328GPUs) cos 0.2 70.902 89.894 Google Drive / cfg resnet18 100 1024 (1288GPUs) cos 0.8 70.994 89.892
resnet18 100 8192 (12864GPUs) cos 6.4 70.165 89.374
resnet18 100 16384 (25664GPUs) cos 12.8 68.766 88.381
resnet50 100 256 (328GPUs) cos 0.2 77.252 93.430 Google Drive / cfg botnet50 100 256 (328GPUs) cos 0.2 77.604 93.682 Google Drive / cfg Training log: https://gist.github.com/BIGBALLON/3d53c81b2b11ea5dd66417c2a985cd89

@oukohou

hello！ the botnet50 pre-trained model's Hyperlink doesn't work,can you share it for me,thank you！

oukohou commented 1 year ago

@rookiiiie leave an email and i will send it to you.

rookiiiie commented 1 year ago

@rookiiiie leave an email and i will send it to you.

my email is：gusiyuan155@126.com

hefei12 commented 1 year ago

@rookiiiie leave an email and i will send it to you.

hello！ the botnet50 pre-trained model's Hyperlink doesn't work,can you share it for me,thank you！ my email is : 15935498018@163.com

artemgalyan commented 11 months ago

@rookiiiie leave an email and i will send it to you.

Hello! Can you please send pre-trained botnet50 model to me? My email is gaa.ww87@gmail.com Thank you!

oukohou commented 11 months ago

image sent. Don't know if this behavior is appropriate, maybe you all contact the author first.

Dindy-R commented 11 months ago

@rookiiiie leave an email and i will send it to you.

hello, can y sent pretrained botnet50 to me? my email : Dindy-R@outlook.com

xinzhichao commented 7 months ago

hello, can y sent pretrained botnet50 to me? my email : xinzhichaomail@foxmail.com

oukohou commented 7 months ago

closing as my problem is solved, people who wants weights may contact the author first.