ezmsg-org / ezmsg

Pure-Python DAG-based high-performance SHM-backed pub-sub and multi-processing pattern
https://ezmsg.readthedocs.io/en/latest/
MIT License
16 stars 6 forks source link

Add `array_chunker` to iterate over chunks of arbitrary npt.ArrayLike objects #144

Closed cboulay closed 2 months ago

cboulay commented 2 months ago

This is useful for tests, examples, and quick offline analyses with small'ish datasets.

cboulay commented 2 months ago

Alternatively, we could create a large AxisArray then add a new chunk_over_axis method to AxisArray.