splitgraph / seafowl

Analytical database for data-driven Web applications 🪶
https://seafowl.io
Apache License 2.0
388 stars 9 forks source link

Add support for object stores with specific paths #470

Closed gruuya closed 7 months ago

gruuya commented 7 months ago

Currently we only support storing data rooted at the object store's bucket level.

In principle users could supply a custom path on the object store where they'd like Seafowl to store data.

This would also allow #469 to for instance have a staging area for parquet tables in one path/bucket and the actual Seafowl data dir in another and then convert the former into proper Delta tables.