search

apache / incubator-xtable

Apache XTable (incubating) is a cross-table converter for lakehouse table formats that facilitates interoperability across data processing systems and query engines.
https://xtable.apache.org/
Apache License 2.0
773 stars 119 forks source link

Docs improvement: Glue Data Catalog #265

Open sagarlakshmipathy opened 7 months ago

sagarlakshmipathy commented 7 months ago

According to https://github.com/onetable-io/onetable/issues/262

Docs needs to clarify

  1. DB names appropriately i.e. instead of onetable_synced_db call it onetable_synced_delta_db (same for hudi and iceberg as well)
  2. Command to create the crawler is incorrect. It should instead be like aws glue create-crawler --name onetable_delta_crawler --role arn:aws:iam::${accountId}:role/service-role/${roleName} --database onetable_synced_delta_db --targets "{\"DeltaTargets\":[{\"DeltaTables\":[\"${s3DataPath}\"],\"WriteManifest\":false,\"CreateNativeDeltaTable\":true}]}"
rahil-c commented 7 months ago

I can take this up @sagarlakshmipathy you can assign this to me

sagarlakshmipathy commented 5 months ago

@rahil-c bump! following up on this. Do you still have bandwidth to address this?