duckdb / uc_catalog

Proof-of-concept extension combining the delta extension with Unity Catalog
MIT License
54 stars 7 forks source link

GCS support? #9

Open yohei1126 opened 2 months ago

yohei1126 commented 2 months ago

uc_api.cpp only has AWS s3 specific implementation only. https://github.com/duckdb/uc_catalog/blob/main/src/uc_api.cpp#L122

Any plan to support Unity Catalog with GCS bucket? https://duckdb.org/docs/guides/network_cloud_storage/gcs_import.html

CREATE SECRET (
    TYPE GCS,
    KEY_ID 'AKIAIOSFODNN7EXAMPLE',
    SECRET 'wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY'
);
yohei1126 commented 2 months ago

Now the credential vending API is in public preview on Databricks GCP https://docs.gcp.databricks.com/en/data-governance/unity-catalog/access-open-api.html