<propose dataset ID(s), and where they fit in the hierarchy, and specify which entity types each will provide (docs, queries, qrels, scoreddocs, docpairs, qlogs)>
Checklist
Mark each task once completed. All should be checked prior to merging a new dataset.
[ ] Dataset definition
[ ] Tests (in tests/integration/[topid].py)
[ ] Metadata generated (using ir_datasets generate_metadata command, should appear in ir_datasets/etc/metadata.json)
[ ] Documentation (in ir_datasets/etc/[topid].yaml)
[ ] Downloadable content (in ir_datasets/etc/downloads.json)
[ ] Download verification action (in .github/workflows/verify_downloads.yml). Only one needed per topid.
[ ] Any small public files from NIST (or other potentially troublesome files) mirrored in https://github.com/seanmacavaney/irds-mirror/. Mirrored status properly reflected in downloads.json.
Dataset Information:
A large-scale Chinese Benchmark for Passage Ranking
Links to Resources:
Dataset ID(s) & supported entities:
Checklist
Mark each task once completed. All should be checked prior to merging a new dataset.
tests/integration/[topid].py
)ir_datasets generate_metadata
command, should appear inir_datasets/etc/metadata.json
)ir_datasets/etc/[topid].yaml
)ir_datasets/etc/downloads.json
).github/workflows/verify_downloads.yml
). Only one needed pertopid
.downloads.json
.Additional comments/concerns/ideas/etc.