apache / kyuubi

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
https://kyuubi.apache.org/
Apache License 2.0
2.08k stars 907 forks source link

[FEATURE] Support impersonation mode for flink sql engine #6368

Open wForget opened 5 months ago

wForget commented 5 months ago

Code of Conduct

Search before asking

Describe the feature

Support impersonation mode for flink sql engine

Motivation

No response

Describe the solution

Add the following options to FlinkProcessBuilder:

HADOOP_PROXY_USER=proxyUser
security.delegation.tokens.enabled=false

Additional context

No response

Are you willing to submit PR?

wForget commented 4 months ago
HADOOP_PROXY_USER=proxyUser
security.delegation.tokens.enabled=false

After turning off security.delegation.tokens.enabled, it is difficult for us to pass delegation token updates of jobmanager to taskmanager.

Based on the solution in https://github.com/apache/flink/pull/22009#issuecomment-2122226755, I will follow the steps:

HADOOP_PROXY_USER=proxyUser
security.module.factory.classes=org.apache.flink.runtime.security.modules.JaasModuleFactory,org.apache.flink.runtime.security.modules.ZookeeperModuleFactory
security.delegation.token.provider.hadoopfs.enabled=false
security.delegation.token.provider.s3-hadoop.enabled=false
security.delegation.token.provider.s3-presto.enabled=false
security.delegation.token.provider.HiveServer2.enabled=false
security.delegation.token.provider.hbase.enabled=false