search

huawei-noah / Pretrained-Language-Model

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
3.02k stars 628 forks source link

TinyBERT finetuned models download is not available #171

Open xwuShirley opened 2 years ago

xwuShirley commented 2 years ago

Dear authors of TinyBERT,

Thanks for the great work. TinyBERT is really a great work and clarifies the ways to do distillation. We would like to apply your final models of TinyBERT (see below, copied from the your github repo). However, it seems not working (it seems in general the links in the repo are not available). We would really appreciate if you could help out.

Cheers, Shirley

"We here also provide the distilled TinyBERT(both 4layer-312dim and 6layer-768dim) of all GLUE tasks for evaluation. Every task has its own folder where the corresponding model has been saved.

TinyBERT(4layer-312dim)

TinyBERT(6layer-768dim)"

LM-AuroTripathy commented 2 years ago

My issues is the same. Any breakthru? Thank you

itsucks commented 2 years ago

TinyBERT models have been uploaded to huggingface.co, you can also download them there.

Toughq commented 2 years ago

There is no finetuned model, only the general distillation model，do you have now?Thank you

Toughq commented 2 years ago

Dear authors of TinyBERT,

Thanks for the great work. TinyBERT is really a great work and clarifies the ways to do distillation. We would like to apply your final models of TinyBERT (see below, copied from the your github repo). However, it seems not working (it seems in general the links in the repo are not available). We would really appreciate if you could help out.

Cheers, Shirley

"We here also provide the distilled TinyBERT(both 4layer-312dim and 6layer-768dim) of all GLUE tasks for evaluation. Every task has its own folder where the corresponding model has been saved.

TinyBERT(4layer-312dim)

TinyBERT(6layer-768dim)"

Hello, have you solved this problem? I'd appreciate it if you could help me

Toughq commented 2 years ago

TinyBERT models have been uploaded to huggingface.co, you can also download them there.

There is no finetuned model, only the general distillation model，do you have the finetuned model? I would be grateful if you could reply me