aplbrain / bossphorus

A BossDB-like volumetric datastore in Rust
Apache License 2.0
1 stars 1 forks source link

[ChunkedBloscFileDataManager] File IO parallelism #8

Open j6k4m8 opened 4 years ago

j6k4m8 commented 4 years ago

Right now, each cuboid on disk is read in series, but we know both the shape as well as the filenames a priori. This could theoretically be parallelized, though it'll require some cleverness with the ndarray API, which I don't believe supports parallel reads/writes by default.