apache / iceberg

Apache Iceberg
https://iceberg.apache.org/
Apache License 2.0
6.49k stars 2.24k forks source link

Time Travel / Snapshot Performance #9112

Open w14 opened 1 year ago

w14 commented 1 year ago

The docs discuss time travel but not the performance / size requirements.

  1. Does Iceberg store changes by row or whole table? So if you have a 100MiB table and you make 100 separates changes (inserts, updates deletes) of 1 row each containing 1KiB, will the total storage on s3 by 100MiB + O(100 1KiB) or O(100 100MiB)?
  2. Is it recommended to track every change (like row level changes) over months or years? Is there some checkpointing?
github-actions[bot] commented 1 month ago

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.