search

allenai / ir_datasets

Provides a common interface to many IR ranking datasets.
https://ir-datasets.com/
Apache License 2.0
309 stars 42 forks source link

How to construct invert index using ir_datasets tools? #215

Closed VincentXWD closed 1 year ago

VincentXWD commented 1 year ago

I'd like to use ir_datasets to construct inverted index using wikir/en59k dataset. Any examples or scripts to use in this repository?

seanmacavaney commented 1 year ago

Yup, there's code examples for indexing on the documentation site:

image

There's also examples in Section 3 of the paper: https://arxiv.org/pdf/2103.02280.pdf

VincentXWD commented 1 year ago

Yup, there's code examples for indexing on the documentation site:

image

There's also examples in Section 3 of the paper: https://arxiv.org/pdf/2103.02280.pdf

got it. that helps me a lot. i don't have to write scripts anymore.