nclskfm / square-core

SQuARE: Software for question answering research.
https://square.ukp-lab.de
2 stars 0 forks source link

Change of format of saved predictions #22

Closed BenediktStuhrmann closed 1 year ago

BenediktStuhrmann commented 1 year ago

We only need the id (of the sample in the respective dataset) and the prediction of the model. (remove question, context, reference_aswers etc.)

The prediction of the query endpoint seems to always consist out of:

"prediction_output" :{
        "output":"Don Mueller",
        "output_score":0.2426052987575531
}

So it would make sense to simply save it like that.

BenediktStuhrmann commented 1 year ago

Basically: Instead of using PredictionAnswer for saving, use PredictionOutput => see here.