Fix hive metastore issues - Githubissues

cuebook / cuelake

Use SQL to build ELT pipelines on a data lakehouse.

https://cuelake.cuebook.ai

Apache License 2.0

283 stars 28 forks source link

Fix hive metastore issues #48

Closed vikrantcue closed 2 years ago

vikrantcue commented 2 years ago

Test the following scenarios on hive metastore for iceberg, delta and parquert tables:

[x] Data should be created in the given warehouse directory as env variable
[x] When table is dropped data should be deleted

Test and fix the behaviour of hive metastore on both S3 and GCS.

Use the latest version of iceberg and delta jars and also upgrade the spark version if required.