Handle ObjectRemoved:Delete events and translate those into Delta table removals

buoyant-data / oxbow

Collection of AWS Lambdas for creating and managing Delta tables

https://www.buoyantdata.com

GNU Affero General Public License v3.0

21 stars 7 forks source link

Closed rtyler closed 10 months ago

rtyler commented 10 months ago

This change will handle deleted files correctly, but will also ensure that removed files don't incorrectly show up as additions.

With this change S3 LifeCycle configurations should just work with Delta tables

Fixes #10