zarr-developers / zarr-benchmark

Benchmarking the performance of various Zarr implementations, using our perfcapture framework.
MIT License
1 stars 2 forks source link

Implement aperio svs workloads (wip) #13

Open ap-- opened 1 year ago

ap-- commented 1 year ago

Here's a work in progress Aperio SVS reading workload.

One workload reads the file via tifffile's ZarrTiffStore the other workload creates a kerchunk json for the file and reads array data via FSStore and fsspec.ReferenceFileSystem.

JackKelly commented 1 year ago

Looks good to me - thanks! LMK when you're happy for me to merge this.

ap-- commented 1 year ago

I'll change the Dataset subclass to generate the input tiff instead of downloading one. Will mark this PR as ready when I added the changes.