search

alibaba / AliceMind

ALIbaba's Collection of Encoder-decoders from MinD (Machine IntelligeNce of Damo) Lab
Apache License 2.0
1.98k stars 291 forks source link

teacher model #47

Open xhqi0109 opened 2 years ago

xhqi0109 commented 2 years ago

Hello, where can I download the teacher model?

wangwei7175878 commented 2 years ago

Could you please be specific about what you mean by teacher model. It's not clear enough for me.

xhqi0109 commented 2 years ago

Thank you for your reply. The teacher model is the teacher's pre training model, as shown in the following code:
teacher = TeacherBertForSequenceClassification.from_pretrained( training_args.teacher_path, from_tf=bool(".ckpt" in training_args.teacher_path), config=config, alignrep=training_args.alignrep, )

RunxinXu commented 2 years ago

Hi，you can train the teacher model conveniently using the scripts provided by huggingface.