-
I'm wondering how we can build virtualization pipelines as a map rather than a map-reduce process. The map paradigm would follow the structure below from [Earthmover's excellent blog post on serverles…
-
Currently we use the metadata DB and AlignmentStore to represent the dataset, which is very tedious. We can store everything in a 300M Zip file using Zarr. Switch to this.
-
### Zarr version
3.0.0.beta
### Numcodecs version
0.13
### Python Version
3.11
### Operating System
Mac
### Installation
pip
### Description
We have not implemented `zarr.copy`, `zarr.copy_…
-
When running evaluation mode figures are being created. Currently, there is no option to output the predictions.
I would like to implement the option to output predictions as a Zarr dataset.
(WIP: h…
-
using main branch.
i'm runnning the following trying write out a 32G (blosc-zstd compressed size) zarr file to a v3 with a single shard.
` ome2024-ngff-challenge resave --cc-by --output-shards 1…
satra updated
15 minutes ago
-
I'm loading [a big bunch of tomographic data](https://github.com/habi/laminitis), crop out small regions, rechunk those with `chunks='auto'` and want to save them to disk with `.to_zarr`.
`dask.__v…
habi updated
23 hours ago
-
Currently we use a consolidated version of the the Zarr store in `zarr.rs` to handle persisting and loading configured zarr stores. Importantly, this is the basis for pickling stores from python.
…
-
### What happened?
We're mainly using NWB-Zarr and found that reading the units table and rendering as a dataframe is prohibitevly slow. This is mainly due to the `electrodes` column that copies th…
-
I previously looked into that but the Rust zarr libraries seem overly complex to me. Maybe a simple reimplementation of the subset of zarr needed for access data is in order.
-
Latest released zarr is still 2.8.13, but numcodecs is already 0.14. They do not play together:
```
[ 97s] _________________________ test_array_with_delta_filter _________________________
[ 97s] …