sgkit-dev / bio2zarr

Convert bioinformatics file formats to Zarr
Apache License 2.0
24 stars 6 forks source link

Improve encoding memory bound estimate #186

Open jeromekelleher opened 4 months ago

jeromekelleher commented 4 months ago

Currently we just return the maximum size of a variant chunk, but there's also some overheads. Some workable rule of thumb would be good here that works across dataset sizes.