Closed Albert-Ma closed 2 years ago
Hi @Albert-Ma, we haven't run any experiments BERT, but you can easily do so yourself as it is already supported by PET. How well it performs and whether it will give similar results to RoBERTa will depend on the particular task. We did run experiments with some other models including ALBERT in this paper.
I see. Thanks.
Thanks for your work! I see most experiments in the paper "Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inference" used RoBERTa large model. So, can the BERT model get similar results with RoBERTa model? Did you try the BERT model?