apache / dolphinscheduler

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
https://dolphinscheduler.apache.org/
Apache License 2.0
12.47k stars 4.51k forks source link

[ERROR] JDBC connection failed when creating hiveserver2 ha zk data source #7548

Closed berg-xu closed 5 days ago

berg-xu commented 2 years ago

Search before asking

What happened

基础环境配置:

dolphinscheduler版本为2.0.1; mysql以及驱动包版本为8.0.19; hive版本为3.1.2; zookeeper版本为3.6.3; jdk 1.8;

hiveserver基于zk完成HA部署。部署完dolphinscheduler确认未使用krb认证服务,创建hive数据源时,按照官方文档使用HiveServer2即默认端口为10000连接hive时提示创建数据源成功。 但是使用HiveServer2 HA Zookeeper创建hive数据源时出现如下错误:

image

通过查询日志获取如下信息:

image

这样的问题该如何解决?

What you expected to happen

创建hive数据源的时候, 默认连接方式是什么?

How to reproduce

基础环境配置:

dolphinscheduler版本为2.0.1; mysql以及驱动包版本为8.0.19; hive版本为3.1.2; zookeeper版本为3.6.3; jdk 1.8;

hiveserver基于zk完成HA部署。部署完dolphinscheduler确认未使用krb认证服务,创建hive数据源时,按照官方文档使用HiveServer2即默认端口为10000连接hive时提示创建数据源成功。

但是使用HiveServer2 HA Zookeeper创建hive数据源时出现如下错误:

image

通过查询日志获取如下信息:

image

Anything else

No response

Version

2.0.1

Are you willing to submit PR?

Code of Conduct

github-actions[bot] commented 2 years ago

Search before asking

-[X] I had searched in the issues and found no similar issues.

What happened

Basic environment configuration:

dolphinscheduler version is 2.0.1; The version of mysql and driver package is 8.0.19; The hive version is 3.1.2; The zookeeper version is 3.6.3; jdk 1.8;

Hiveserver completes HA deployment based on zk. After deploying the dolphinscheduler, confirm that the krb authentication service is not used. When creating the hive data source, use HiveServer2 according to the official document, that is, the default port is 10000 to connect to hive. It prompts that the data source is created successfully. However, the following error occurred when using HiveServer2 HA Zookeeper to create a hive data source:

image

Obtain the following information by querying the log:

image

How to solve this problem?

What you expected to happen

When creating a hive data source, what is the default connection method?

How to reproduce

Basic environment configuration:

dolphinscheduler version is 2.0.1; The version of mysql and driver package is 8.0.19; The hive version is 3.1.2; The zookeeper version is 3.6.3; jdk 1.8;

Hiveserver completes HA deployment based on zk. After deploying the dolphinscheduler, confirm that the krb authentication service is not used. When creating the hive data source, use HiveServer2 according to the official document, that is, the default port is 10000 to connect to hive. It prompts that the data source is created successfully.

However, the following error occurred when using HiveServer2 HA Zookeeper to create a hive data source:

image

Obtain the following information by querying the log:

image

Anything else

No response

Version

2.0.1

Are you willing to submit PR?

-[X] Yes I am willing to submit a PR!

Code of Conduct

-[X] I agree to follow this project's Code of Conduct

github-actions[bot] commented 2 years ago

Hi:

Narcasserun commented 2 years ago

https://github.com/apache/dolphinscheduler/pull/7489