search

timoschick / pet

This repository contains the code for "Exploiting Cloze Questions for Few-Shot Text Classification and Natural Language Inference"
https://arxiv.org/abs/2001.07676
Apache License 2.0
1.62k stars 283 forks source link

The performance of BERT using PET technique #54

Closed Albert-Ma closed 2 years ago

Albert-Ma commented 2 years ago

Thanks for your work! I see most experiments in the paper "Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inference" used RoBERTa large model. So, can the BERT model get similar results with RoBERTa model? Did you try the BERT model?

timoschick commented 2 years ago

Hi @Albert-Ma, we haven't run any experiments BERT, but you can easily do so yourself as it is already supported by PET. How well it performs and whether it will give similar results to RoBERTa will depend on the particular task. We did run experiments with some other models including ALBERT in this paper.

Albert-Ma commented 2 years ago

I see. Thanks.