Open mam10eks opened 1 year ago
I would like to implement this ticket.
cc @samarthbhargav
Dear all, I now had the time to implement this in this branch: https://github.com/mam10eks/ir_datasets/tree/trec-tip-of-the-tongue
Basically, everything is resolved, but I forgot how to do these two steps:
Otherwise, everything seems to be ready.
@seanmacavaney I forgot, was there some documentation on how to do those two steps?
Dataset Information:
The training and dev data of the TREC 2023 Tip-of-the-Tongue track are now available: https://trec-tot.github.io/guidelines
Description from the website:
Dataset ID(s) & supported entities:
tip-of-the-tongue/train
tip-of-the-tongue/dev
tip-of-the-tongue/test
(not yet released)Checklist
Mark each task once completed. All should be checked prior to merging a new dataset.
ir_datasets/datasets/[topid].py
)tests/integration/[topid].py
)ir_datasets generate_metadata
command, should appear inir_datasets/etc/metadata.json
)ir_datasets/etc/[topid].yaml
)ir_datasets/etc/downloads.json
).github/workflows/verify_downloads.yml
). Only one needed pertopid
.downloads.json
.Additional comments/concerns/ideas/etc.