GPT2 SEQUENCE_CLASSIFIER_WRAPPER missing

timoschick / pet

This repository contains the code for "Exploiting Cloze Questions for Few-Shot Text Classification and Natural Language Inference"

https://arxiv.org/abs/2001.07676

Apache License 2.0

1.62k stars 283 forks source link

GPT2 SEQUENCE_CLASSIFIER_WRAPPER missing #35

Closed FlorisFok closed 3 years ago

FlorisFok commented 3 years ago

gpt2 is missing the SEQUENCE_CLASSIFIER_WRAPPER; GPT2ForSequenceClassification, which is available in the transformer module.

timoschick commented 3 years ago

Hi Floris,

I don't know GPT2ForSequenceClassification well enough to be sure that it works with our codebase out of the box, which is why I didn't add it. If you've already added it yourself and didn't observe any problems, feel free to create a pull request :)