Have you ever tried to train bigger models?

youngwanLEE / MPViT

[CVPR 2022] MPViT:Multi-Path Vision Transformer for Dense Prediction

https://arxiv.org/abs/2112.11010

Other

364 stars 40 forks source link

Have you ever tried to train bigger models? #6

Open christophschuhmann opened 2 years ago

christophschuhmann commented 2 years ago

Have you ever tried to train bigger models? Like L, H or G?

If yes, what were the results

christophschuhmann commented 2 years ago

I am one of the chairman of LAION, https://laion.ai . If you are interested, we could probably provide your compute and try to train bigger models together. :)