airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
14.75k stars 3.79k forks source link

Destination Azure Blob Storage: specify storage path/location #14248

Open TamGB opened 2 years ago

TamGB commented 2 years ago

Tell us about the problem you're trying to solve

When using an Azure Blob Storage destination the storage location is defined by Airbyte. The goal is to allow for the location to be determined by a template, for instance, /%YYYY%/%MM%/%DD%/

Describe the solution you’d like

The ability to define the storage location template within the UI to make sure every new change / increment is stored within its own blob definition

Like it is available for S3 in the S3 Path Format variable

TamGB commented 2 years ago

Hi @harshithmullapudi , Any chance we can get some additional information? Is it a priority, does it fit in any timeline (Q3, Q4) etc? :)

No pressure, just to align expectations!

TamGB commented 1 year ago

The issue would be sorted automatically via issue 5687