meggart / DiskArrays.jl

Other
73 stars 13 forks source link

fix iteration performance #114

Closed rafaqz closed 11 months ago

rafaqz commented 12 months ago

A few fixes for iteration performance, mostly gridchunks having an abstract type field was causing a lot of overhead.

There is still a pretty big cost from Iterators.Stateful for Unchunked() arrays that don't actually need it. We can probably fix that as well at some stage.

(I moved the code into _iterate_disk so we can do more of this work in future more easily)