[ ] An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
[ ] My own task or dataset (give details below)
Reproduction
I recently read this and was wondering how to use distill-BERT (which is pre-trained with imdb dataset) with a different dataset (for eg. this dataset)?
System Info
transformers
version: 4.11.3Who can help?
@ArthurZucker @younesbelkada @sgugger
Information
Tasks
examples
folder (such as GLUE/SQuAD, ...)Reproduction
I recently read this and was wondering how to use distill-BERT (which is pre-trained with imdb dataset) with a different dataset (for eg. this dataset)?
Expected behavior
Distill-BERT should work with different datasets.