Clarification on how to interpret PET's results

timoschick / pet

This repository contains the code for "Exploiting Cloze Questions for Few-Shot Text Classification and Natural Language Inference"

https://arxiv.org/abs/2001.07676

Apache License 2.0

1.62k stars 282 forks source link

Clarification on how to interpret PET's results #97

Open aliromagnoli opened 1 year ago

aliromagnoli commented 1 year ago

When running PET on my task I obtain two "results_text" files with different metric values. One is in the main directory, while the other is in the "final" directory. I assumed that the one in the main directory is from all epochs averaged, while the one in "final" regards the last epoch. Can you please confirm this or explain how to interpret the two files?

SanaNGU commented 1 year ago

Hi @aliromagnoli , did you eventually interpret PET's results? I am also confused

aliromagnoli commented 1 year ago

Hi @SanaNGU, at the end I decided to consider just the "results_text" file in the main directory assuming it is the results of all the epochs averaged. I hope my interpretation is correct.