Fully training a model using PET

timoschick / pet

This repository contains the code for "Exploiting Cloze Questions for Few-Shot Text Classification and Natural Language Inference"

https://arxiv.org/abs/2001.07676

Apache License 2.0

1.62k stars 283 forks source link

Fully training a model using PET #38

Closed ghost closed 3 years ago

ghost commented 3 years ago

I know PET is only for fine tuning pre-trained models, but is it possible to fully train a model of your own with PET? From scratch, like?

ghost commented 3 years ago

I can just start with random weights if I don't want the initial weights to be those of a pre-trained model. I've figured it out, this was a stupid question. Anyway, I'm closing the issue!