How to pretrain UniLM from zero on my own data?

microsoft / unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

https://aka.ms/GeneralAI

MIT License

19.11k stars 2.44k forks source link

Open xealml opened 2 years ago

xealml commented 2 years ago

Describe Model I am using (UniLM, MiniLM, LayoutLM ...): UniLM

thomas-li-sjtu commented 2 years ago

Hi, I got the same issue and I wonder if you have solved the problem?

zxk19981227 commented 2 years ago

Same problem， Is there any official issue to solve this problem?