Could `dencode_init` return an upper memory use bound?

sgkit-dev / bio2zarr

Convert bioinformatics file formats to Zarr

Apache License 2.0

24 stars 6 forks source link

Could `dencode_init` return an upper memory use bound? #188

Closed benjeffery closed 4 months ago

benjeffery commented 4 months ago

Currently when running dencode_partition I'm having to guess the RAM needed and increase it as the test partition fails. Might be nice for the user to have some way of knowing how much will be needed?

jeromekelleher commented 4 months ago

dencode_init returns this as part of the output. It's an underestimate currently (#186), but a reasonable starting point.

jeromekelleher commented 4 months ago

The output formatting has been improved recently, I'll document usage soon.

benjeffery commented 4 months ago

Ah great, i'm still on 0.0.9, so hadn't seen that.