castorini / pygaggle

a gaggle of deep neural architectures for text ranking and question answering, designed for Pyserini
http://pygaggle.ai/
Apache License 2.0
340 stars 100 forks source link

Ranking on Query/Documents of custom dataset #314

Open ahadda5 opened 1 year ago

ahadda5 commented 1 year ago

I'd like to benchmark monoT5 against a custom dataset which has 25 possible labels/targets. The model generates a seq, I'm still not sure how you can transform that to logits representing specific targets/labels? Is there a notebook for custom datasets ? thanks