search

microsoft / unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
https://aka.ms/GeneralAI
MIT License
20.2k stars 2.55k forks source link

BEIT-3 Code and Pre-trained model #1011

Closed xinghua-qu closed 1 year ago

xinghua-qu commented 1 year ago

Hi,

May I ask when will the code and pretrainde model of BEIT-3 be released? Thanks

donglixp commented 1 year ago

Our colleague Wenhui is working on this. Will push it soon.

donglixp commented 1 year ago

The code and pre-trained models of BEiT-3 can be found at aka.ms/beit3.

xinghua-qu commented 1 year ago

The code and pre-trained models of BEiT-3 can be found at aka.ms/beit3.

Thanks for informing me here. It is great for referring your shared code. Besides the fine-tuning, may I ask will the pretraining code be added thereafter?