socialfoundations / folktables

Datasets derived from US census data
MIT License
240 stars 19 forks source link

Refactor data downloading #2

Closed millerjohnp closed 3 years ago

millerjohnp commented 3 years ago

Right now, the user has to download all of the data and unzip it ahead of time in a particular directly. This should be handled JIT. As the user requests a particular data split, e.g., California 2018 1-Year, we should download (if needed) just that particular part of the dataset and cache it (in an optionally user-specified location).