search

iamaziz / PyDataset

Instant access to many datasets in Python.
MIT License
935 stars 86 forks source link

local caching #10

Closed mynameisvinn closed 7 years ago

mynameisvinn commented 7 years ago

including local caching to minimize io calls.

more specifically, dataset is cached in temp directory.

iamaziz commented 7 years ago

Thanks! sounds like a cool idea to integrate with a future scaling. I am a bit hesitant to add another dependency at the moment; beside the size of current datasets are not too large.