datavane / datasophon

The next generation of cloud-native big data management expert , Aims to help users rapidly build stable, efficient, and scalable cloud-native platforms for big data.
https://datasophon.github.io/datasophon-website/
Apache License 2.0
1.08k stars 378 forks source link

[Improvement][Zookeeper][Kafka][Kerberos]Rearchitect the kernel design of Zookeeper and Kafka #494

Closed zhangkeyu008 closed 8 months ago

zhangkeyu008 commented 8 months ago

Purpose of the pull request

  1. Resolve the issue of inability to access root node information on the server using the zkCli. sh command after enabling kerberos in zookeeper

Brief change log

After enabling Kerberos authentication in Zookeeker, an error message appears when executing bin/zkCli. sh in the installation directory of Zookeeker, as shown below zookeeper启动kerberos后,无法在服务器使用zkCli sh命令,但是通过zookeeper的API可以访问

  1. kafka的相关问题 原来的kafka开启kerberos后,有两个不优雅的地方, 第一,执行kafka常用命令报错

kakfa执行常用命令报错2

第二,修复第一问题后,登陆服务器的用户即使不kinit认证用户,也可以访问开启kerberos的kafka信息 kafka在不通过认证的前提下,也能使用kafka命令

个人理解,既然开启了kerberos就要限制用户的认证,只有通过认证的用户才能够访问kafka信息,而不是固定写死kafka的kerberos登陆用户,我重新设计了kafka的kerberos配置,并修复了kafka常用命令不能使用的问题

Verify this pull request

This pull request is already covered by existing tests