As discussed in #79 -- this PR includes a rudimentary listdir for HttpStore that accesses and parses consolidated metadata.
I've introduced vcr for testing and memoise to avoid repeated requests to http resources.
This PR now also includes use of consolidated metadata for httpstore and other reads. Testing could be a bit more complete, but I feel pretty good about it. Performance is WAY WAY better when trying to access all the metadata for a store.
Happy to refactor or rework this if the pattern I put in isn't in line with your vision here @keller-mark -- R6 is totally new to me so this is a bit hacky -- hopefully I am seeing the forest for the trees!
As discussed in #79 -- this PR includes a rudimentary listdir for HttpStore that accesses and parses consolidated metadata.
I've introduced
vcrfor testing andmemoiseto avoid repeated requests to http resources.This PR now also includes use of consolidated metadata for httpstore and other reads. Testing could be a bit more complete, but I feel pretty good about it. Performance is WAY WAY better when trying to access all the metadata for a store.
Happy to refactor or rework this if the pattern I put in isn't in line with your vision here @keller-mark -- R6 is totally new to me so this is a bit hacky -- hopefully I am seeing the forest for the trees!