search

pinterest / querybook

Querybook is a Big Data Querying UI, combining collocated table metadata and a simple notebook interface.
https://www.querybook.org
Apache License 2.0
1.87k stars 228 forks source link

Adding Kerberos for Enterprise #1481

Open Maksllo opened 1 month ago

Maksllo commented 1 month ago

Hello, I am trying to create a pipeline for a large company and I encountered issues as the product does not support Kerberos for integration with Hive at all. Can you please advise if there are plans to add Kerberos and which direction I should look in order to do it myself? Also, can you explain how the product will work if I specify waggle-dance in the metastore?

baumandm commented 1 month ago

Hey @Maksllo, I can't help with Kerberos, but we are using Waggle Dance as the metastore with the built-in HMSMetastoreLoader, and it works exactly as expected.

Since Waggle Dance implements the Hive Metastore API itself, all the metastores features will work in Querybook without any modifications needed.

Maksllo commented 3 weeks ago

Hey @Maksllo, I can't help with Kerberos, but we are using Waggle Dance as the metastore with the built-in HMSMetastoreLoader, and it works exactly as expected.

Since Waggle Dance implements the Hive Metastore API itself, all the metastores features will work in Querybook without any modifications needed.

Hello @baumandm , thank you for your message. I have made progress in connecting to Hadoop Kerberos. Could you clarify one question for me? When our users receive data from the metastore in the data warehouse, they see different data in Hue (only what is accessible to them). As I understand it, querybook (QB) operates on a completely different logic, and I may not be able to configure it so that only the user's data is displayed in the "tables" tab of the interface. If I am mistaken, could you please explain in more detail how this works? For example, I do not understand two things: 1) Why are the metastores separated so distinctly (why is it not done like in Hue)? 2) What is the purpose of specifying the metastore in the engine?