ray-project / deltacat

A portable Pythonic Data Catalog API powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to your big data workloads.
Apache License 2.0
162 stars 23 forks source link

Add delete_many functionality to object store #360

Closed yankevn closed 1 month ago

yankevn commented 1 month ago

This change adds the delete_many functionality to object stores. This is necessary to cleanup the object store between rounds of compaction.

raghumdani commented 1 month ago

Looks good overall. Be sure to test thoroughly before merging..