Implement Kube Logging for other Cloud Providers.

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

https://airbyte.com

Other

15.32k stars 3.96k forks source link

Implement Kube Logging for other Cloud Providers. #4200

Closed davinchia closed 1 month ago

davinchia commented 3 years ago

Tell us about the problem you're trying to solve

Today we only support S3. Implement this for the other cloud providers.

Describe the solution you’d like

[x] GCS logging
[ ] Azure logging (https://github.com/airbytehq/airbyte-internal-issues/issues/169)
[x] Minio logging

mhensley-cls commented 3 years ago

FYI - Some orgs utilizing on prem kubernetes might leverage something like https://min.io/ - an S3 API compliant storage alternative.

jrhizor commented 3 years ago

@mhensley-cls we're actually planning on supporting minio as the default testing option so users won't need to configure s3/gcs when testing.

mhensley-cls commented 3 years ago

Ahh, cool. Found it - https://github.com/airbytehq/airbyte/issues/4206