danthegoodman1 / icedb

An in-process Parquet merge engine for better data warehousing in S3
https://blog.danthegoodman.com/icedb-v3--third-times-the-charm
Other
128 stars 5 forks source link

Rewrite partition concurrency #110

Open danthegoodman1 opened 1 year ago

danthegoodman1 commented 1 year ago

When performing partition rewrite, we should be able to specify how many files will be processed concurrently.