aws-samples / aws-glue-samples

AWS Glue code samples
MIT No Attribution
1.42k stars 812 forks source link

EMR Hive Metastore to Glue Migration #144

Open ShubhamSharmaCSE opened 1 year ago

ShubhamSharmaCSE commented 1 year ago

I was going through this documentation to migrate from Hive Metastore to the Glue Data catalog specifically the section "Migrate the Amazon EMR Hive Metastore to the AWS Glue Data Catalog" here: https://aws.amazon.com/blogs/big-data/upgrade-amazon-emr-hive-metastore-from-5-x-to-6-x/

Here, based on that, it mentions the script here: https://github.com/aws-samples/aws-glue-samples/tree/master/utilities/Hive_metastore_migration

I was going through the README and the script to import from hive metastore and saw it mentions MYSQL as the driver.

I am using external Hive Metastore as Maria DB RDS. How to work with this script to perform the migration? The documentation https://aws.amazon.com/blogs/big-data/upgrade-amazon-emr-hive-metastore-from-5-x-to-6-x/ says steps are same for other db engines but the script specifically works for MySQL.

Any suggestions?