scverse / spatialdata

An open and interoperable data framework for spatial omics data
https://spatialdata.scverse.org/
BSD 3-Clause "New" or "Revised" License
235 stars 44 forks source link

Benchmarks performance on HPC #741

Open LucaMarconato opened 1 week ago

LucaMarconato commented 1 week ago

CC @melonora @berombau

Working with Zarr files on a HPC may create problems due to Zarr v2. One of the challenges for the hackathon will be to setup a set of benchmarks, which will help evaluate the transition to Zarr v3.

berombau commented 6 days ago

Linking to #768, which is more on documenting on how to setup on the HPC. This issue is more on doing benchmarks on HPC once setup and creating datasets for such a benchmark.