github-actions[bot]
commented
1 year ago Search before asking
- [X] I had searched in the issues and found no similar issues.
What happened
After correctly configuring hive on spark, after starting the hiveserver2 service through Datasophon, there is an error when executing the insert statement through the SQL tool (dbeaver/dbvisualer, etc.);
Error message:
[Code: 40000, SQL State: 42000] Error while compiling statement: FAILED: SemanticException Failed to get a spark session: org.apache.hadoop.hive.ql.metadata.HiveException: Failed to create Spark client for Spark session 75f8b669- 1482 -4ea3-b50e-c6f8484afa9a
What you expected to happen
It is guessed that there may be a problem with the environment variables of the Datasophon startup script.
How to reproduce
datasophon version 1.1.1; hive version 3.1.3; spark version 3.3.0; hadoop version 3.3.3; self-compiled hive, compatible with spark version; after datasophon is deployed, the problem can be reproduced.
Anything else
No response
Version
main
Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
Code of Conduct
- [X] I agree to follow this project's Code of Conduct
Search before asking
What happened
正确配置hive on spark后，通过Datasophon启动hiveserver2服务后，通过SQL工具(dbeaver/dbvisualer等)执行insert 语句存在报错； 但在服务器上通过hiveserver2的命令直接启动，通过SQL工具执行insert语句通过。
报错信息： [Code: 40000, SQL State: 42000] Error while compiling statement: FAILED: SemanticException Failed to get a spark session: org.apache.hadoop.hive.ql.metadata.HiveException: Failed to create Spark client for Spark session 75f8b669-1482-4ea3-b50e-c6f8484afa9a
What you expected to happen
猜测可能是Datasophon启动脚本的环境变量存在问题。
How to reproduce
datasophon版本1.1.1； hive版本3.1.3； spark版本3.3.0； hadoop版本3.3.3；自行编译hive，兼容spark版本； datasophon部署后，可以复现问题。
Anything else
No response
Version
main
Are you willing to submit PR?
Code of Conduct