search

ExpressAI / omneval

Prompting Evaluation for Pretrained Language Models
1 stars 1 forks source link

prompting evaluation QA-Squad? #9

Open pfliu-nlp opened 3 years ago

pfliu-nlp commented 3 years ago

Prompt: paragraph + question framework: generation-based

pfliu-nlp commented 3 years ago

Notably, for QA evaluation, we usually need to normalize the answer first.

vincent1rookie commented 3 years ago

How to normalize?