Consider adding DistilBERT

thunlp / PLMpapers

Must-read Papers on pre-trained language models.

MIT License

3.33k stars 436 forks source link

Closed ZhengZixiang closed 5 years ago

ZhengZixiang commented 5 years ago

DistilBERT is proposed by Hugging Face and implemented in pytorch-transformers. I think this work is worth adding to the repo.

zzy14 commented 5 years ago

Thanks for your suggestion. Added it.