Missing pre-training code for beit-3?

microsoft / unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

https://aka.ms/GeneralAI

MIT License

19.11k stars 2.44k forks source link

Open sjtulyf123 opened 9 months ago

sjtulyf123 commented 9 months ago

Dear authors, I'm trying to pre-train beit-3 based on my own dataset. I wonder where can I find the pre-training code for beit-3?

flyfatty commented 8 months ago

How do you solve it in the end ？