search

NeurodataWithoutBorders / lindi

Linked Data Interface (LINDI) - cloud-friendly access to NWB data
BSD 3-Clause "New" or "Revised" License
1 stars 1 forks source link

Use zarr FSStore and fsspec ReferenceFileSystem #80

Open rly opened 1 month ago

rly commented 1 month ago

See https://github.com/NeurodataWithoutBorders/lindi/issues/78#issuecomment-2143762446

rly commented 1 month ago

Tests are failing. I'm sure there are differences between the existing LindiReferenceFileSystemStore and FSStore with a fsspec ReferenceFileSystem that need to be resolved, but for a relatively simple test, I was happy to see that this worked and sped up reads by a factor of 1.7x