General purpose evaluator template

tira-io / tira

The source code for the TIRA Shared Task Platform

https://www.tira.io/

MIT License

14 stars 9 forks source link

Open webis-scripts opened 1 year ago

webis-scripts commented 1 year ago

Universal evaluator image with all main standard metrics.

Support for evaluator parameter selection in the Tira dataset/task UI.

kaaage commented 1 year ago

Oops. Wrong account.

mam10eks commented 1 year ago

We already started wit an evaluator template for ir-measures, so it might be worth to join forces here.

github-actions[bot] commented 1 year ago

This issue has been marked stale because it has been open 60 days with no activity.