allenai / ir_datasets

Provides a common interface to many IR ranking datasets.
https://ir-datasets.com/
Apache License 2.0
306 stars 40 forks source link

Touche 2023 #218

Open heinrichreimer opened 1 year ago

heinrichreimer commented 1 year ago

Once we get the ClueWeb22 merged (see #213), we can also add the ongoing Touché 2023 shared tasks.

This doesn't add new docs but of course queries and qrels:

Feels great to finally have ir_datasets integration ready for our participants of the ongoing shared task. This certainly helps our students a lot and we plan to give them a hands-on tutorial using PyTerrier and ir_datasets that way.

Also this is blocked by #213 as it depends on the docs from the ClueWeb22.

seanmacavaney commented 1 year ago

Awesome! Let's sort out #213 first, then this should be easy.

heinrichreimer commented 1 year ago

Exactly :+1:

heinrichreimer commented 1 year ago

I've updated the branch to reflect upstream changes and added default_text() implementations.