search

awslabs / aws-glue-data-catalog-client-for-apache-hive-metastore

The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog as a central repository to store structural and operational metadata for their data. AWS Glue provides out-of-box integration with Amazon EMR that enables customers to use the AWS Glue Data Catalog as an external Hive Metastore. This is an open-source implementation of the Apache Hive Metastore client on Amazon EMR clusters that uses the AWS Glue Data Catalog as an external Hive Metastore. It serves as a reference implementation for building a Hive Metastore-compatible client that connects to the AWS Glue Data Catalog. It may be ported to other Hive Metastore-compatible platforms such as other Hadoop and Apache Spark distributions
https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-hive-metastore-glue.html
Apache License 2.0
197 stars 118 forks source link

Cannot Build Spark Client. #28

Open mohanhh opened 4 years ago

mohanhh commented 4 years ago

I followed all the instructions but I just cannot build aws-glue-datacatalog-spark-client. The problem seems to be aws-glue-datacatalog-spark-client depends on org.spark-project.hive while the instructions provided in README ask you to download hive 1.2 build org.apache.hive.

I even tried to download spark project and built 1.2 version. But spark builds 1.2 version and not 1.2.3-SNAPSHOT as mentioned.

Any idea how this can be fixed ?

kidotaka commented 3 years ago

6