brayanjuls / diane

Hive helper functions for apache spark users
MIT License
10 stars 0 forks source link

High level Hive metastore vision #4

Open brayanjuls opened 1 year ago

brayanjuls commented 1 year ago

Many Spark users are registering tables in a Hive metastore without any idea of what the Hive metastore is, its basic functionality, and best practices for leveraging the Hive metastore.

We should brainstorm how to provide end user interfaces that demystify the Hive metastore for end users. What tables are registered, what are the paths, which tables are external/managed, etc.

Guidance on how to convert from external => managed and from not registered => external are examples of issues that baffle Spark users, myself included.

The purpose of this issue is to brainstorm the types of interfaces we can provide end users.

Issue migrated from https://github.com/MrPowers/jodie/issues/16