splitgraph / seafowl

Analytical database for data-driven Web applications 🪶
https://seafowl.io
Apache License 2.0
388 stars 9 forks source link

Implement eager dropping of tables and schemas #480

Closed gruuya closed 6 months ago

gruuya commented 6 months ago

Replace the complex lazy mechanism for dropping tables/schemas, which defers the resource cleanup to a VACUUM command, with eager deletion using the bulk deletion API in object_store.

For now keep the repository API and try to purge any remaining entries on startup, so that we can perform the migration (i.e. drop the dropped_tables catalog table) on the next minor release. This will greatly simplify the new TableStore interface.