thunlp / OpenPrompt

An Open-Source Framework for Prompt-Learning.
https://thunlp.github.io/OpenPrompt/
Apache License 2.0
4.38k stars 455 forks source link

Can this framework using in Multiple-Choice question? #229

Open BAOOOOOM opened 1 year ago

BAOOOOOM commented 1 year ago

Multiple-Choice question like CSQA dataset require select one choice from candidate choice. The previous approach was to input questions and train on the answers as labels. In the testing phase, the loss is calculated by taking the question as input and the individual options as temporary labels. The one with the smallest loss is selected as the predicted answer. I find that there is no introduction to using openprompt on multiple choice tasks, so is there a pipeline of that type? Thank you!