search

allenai / ir_datasets

Provides a common interface to many IR ranking datasets.
https://ir-datasets.com/
Apache License 2.0
318 stars 42 forks source link

check for adequate storage #87

Closed seanmacavaney closed 3 years ago

seanmacavaney commented 3 years ago

Checks before downloading files and creating some of the larger docstores, and throws an exception if there's not enough storage.

Can be disabled with an environment variable.

fixes #86