csensemakers / desci-sense

2 stars 2 forks source link

Output not normalized in wandb prediction log #59

Closed ronentk closed 9 months ago

ronentk commented 9 months ago

example - https://wandb.ai/common-sense-makers/st-app-multi-v1/artifacts/prediction/pred_qrwsljqa_ijr8KM9y/v0/files/predictions.table.json

should be a list of valid labels

ronentk commented 9 months ago

@ShaRefOh ok this should be resolved, see https://wandb.ai/common-sense-makers/st-demo-sandbox/artifacts/prediction/pred_7pn23kna_NLLEevRC/v0/files/predictions.table.json

ronentk commented 9 months ago

The code you can use to get from the Final Answer field to Predicted Label is here:

https://github.com/csensemakers/desci-sense/blob/b88c21e72cbe7ae7b225173a8cd1318dc667863d/desci_sense/postprocessing/output_parsers.py#L69