3주차 코드 발표: DistilBERT, a distilled version of BERT_smaller, faster, cheaper and lighter

[najaehwa]

논문 제목

• DistilBERT, a distilled version of BERT_smaller, faster, cheaper and lighter

참고 자료

• https://huggingface.co/docs/transformers/model_doc/distilbert
• https://github.com/huggingface/transformers/tree/main/examples/research_projects/distillation