search

thunlp / KnowledgeablePromptTuning

kpt code
206 stars 21 forks source link

Is it correct? Manual prompt is better than KPT ? #11

Closed znsoftm closed 2 years ago

znsoftm commented 2 years ago

for the up-to-date code of KPT, I get the bellow result on dataset Agnews for Zeroshot:

KPT: Acc: 0.5125 Manual: Acc: 0.6589473684210526

Is it correct ?

znsoftm commented 2 years ago

sorry, after calibration, the acc is : Acc: 0.8505263157894737