Azkaban 调度hql 任务失败

WeBankFinTech / DataSphereStudio

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

https://github.com/WeBankFinTech/DataSphereStudio-Doc

Apache License 2.0

3.08k stars 1k forks source link

Azkaban 调度hql 任务失败 #130

Closed jkl0898 closed 4 years ago

jkl0898 commented 4 years ago

版本： wedatasphere-dss-0.7.0 wedatasphere-linkis-0.9.3

azkaban 为一键部署生成

现象：运行azkaban 报相关jackson 类找不到，如下图：

定位原因： azkaban/lib 下有jackson-core-2.2.2.jar ， plugins 目录下的版本为 plugins/jobtypes/linkis/lib/jackson-core-2.9.6.jar 。两者冲突。

解决建议：统一jar 包的版本，如将azkaban/lib 更新为jackson-core-2.9.6.jar。

目前通过更新azkaban/lib 包为jackson-core-2.9.6.jar 任务运行成功。

yangzhiyue commented 4 years ago

There are some low-version jars in Azkaban , But it will be excluded in Schedulis of WeDataSphere, I strongly recommend that you use Schedulis https://github.com/WeBankFinTech/Schedulis