search

spark-redshift-community / spark-redshift

Performant Redshift data source for Apache Spark
Apache License 2.0
136 stars 62 forks source link

[Feature] Support Automount RS #153

Closed singhpk234 closed 7 months ago

singhpk234 commented 9 months ago

About the change

This adds support for automount feature of redshift which essentially treats the schema name as glue db name more details : https://aws.amazon.com/blogs/big-data/simplify-external-object-access-in-amazon-redshift-using-automatic-mounting-of-the-aws-glue-data-catalog/

bsharifi commented 9 months ago

@singhpk234 Thank you for your feature submission. It is currently under review.

bsharifi commented 8 months ago

@singhpk234 We are currently in the process of adding support for this feature in a more general purpose way that will support both auto-mounted databases as well as other forms of data shares. Because of that, we will not be able to merge this PR. However, we greatly appreciate your submission and look forward to your feedback on the upcoming feature.

singhpk234 commented 8 months ago

We are currently in the process of adding support for this feature in a more general purpose way that will support both auto-mounted databases as well as other forms of data shares

Do you have any timelines regarding when this support will be available ? @bsharifi

bsharifi commented 8 months ago

@singhpk234 A fix for this issue will be part of the next release of the connector. I don't have a firm date though unfortunately.

bsharifi commented 7 months ago

Hi @singhpk234, we are reopening and merging your feature since we were able to leverage some of your changes as part of our upcoming changes around this feature. Thanks again for contributing to the connector!