apache / kyuubi

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
https://kyuubi.apache.org/
Apache License 2.0
2.11k stars 916 forks source link

[Bug] How to use GROUP Share Level without Hadoop #6683

Closed A-little-bit-of-data closed 2 months ago

A-little-bit-of-data commented 2 months ago

Code of Conduct

Search before asking

Describe the bug

I started the kyuubi pod in a k8s environment and used spark SQL to query S3 data. There is no Hadoop environment at all. However, according to the documentation, the kyuubi.session.group.provider configuration seems to only have hadoop. Does that mean that GROUP Share Level can only be used in an environment with hadoop?

Affects Version(s)

1.9.1

Kyuubi Server Log Output

No response

Kyuubi Engine Log Output

No response

Kyuubi Server Configurations

No response

Kyuubi Engine Configurations

No response

Additional context

No response

Are you willing to submit PR?

wangzhigang1999 commented 2 months ago

According the code, it appears that Hadoop is currently the only built-in implementation.

However, according to org.apache.kyuubi.plugin.PluginLoader#loadGroupProvider, you can implement the GroupProvider interface to create your own plugin.