Closed ddobokki closed 2 years ago
Hi,
In the unsupervised setting, we train the model with the CLS representation and evaluate the model with the representation before CLS. It is found to the best on English STS. However the gap is not very large and it could vary on different datasets or languages.
thank you!! I got it! Thanks for the good explanation! 👍
hello! i have some question
in README.md, cls_before_pooler arguments is expained
but in "run_unsup_example.sh", it take "cls" option
is it just mistake? or used in experiment?
in simple experiment using korean PLM, take cls_before_pooler option get more good scores
and thank you!