Handle size of the ChangeSet too large for memory

earth-mover / icechunk

Open-source, cloud-native transactional tensor storage engine

https://icechunk.io

Apache License 2.0

295 stars 18 forks source link

Open dcherian opened 1 month ago

dcherian commented 1 month ago

This could happen, for example, if the inline threshold is large and too many inline chunks.