[TASK][MEDIUM] Third-party projects/tools integration

pan3793 commented 1 year ago

Code of Conduct

[X] I agree to follow this project's Code of Conduct

Search before creating

[X] I have searched in the task list and found no similar tasks.

Mentor

[X] I have sufficient knowledge and experience of this task, and I volunteer to be the mentor of this task to guide contributors to complete the task.

Skill requirements

Knowledge of Kyuubi
Familiar with the open-source ecosystem

Background and Goals

Compared to existing Hadoop/Hive/Spark projects, the community of Apache Kyuubi is quite young but growing fast.

As Kyuubi chooses to be compatible with the HiveServer2 thrift protocol, most of the Hive clients could be used to connect Kyuubi without modification, which makes lots of projects/tools support Apache Kyuubi naturally since they already support Apache Hive. Meanwhile, there are some Kyuubi dedicated features that may require the third-party project/tool to write the dedicated code to leverage, e.g. the Kyuubi modified beeline could retrieve more logs during engine bootstrapping, which simplifies the steps of troubleshooting in certain cases.

Promoting Kyuubi by verifying the projects/tools that support Apache Hive whether work for Kyuubi, enhancing the docs of the third-party projects/tools by mentioning the support of Kyuubi, or improving the code of the third-party projects/tools to make it support Kyuubi are good ways for building the Kyuubi community.

Implementation steps

Find the third-party project/tool that supports Apache Hive, and verify it also works well with Apache Kyuubi without modification, then update the third-party project/tool's docs to mention the Apache Kyuubi support.
Find the third-party project/tool that supports Apache Hive, but can not work well with Kyuubi out-of-box, investigate and fix the issue to make it work.
Integrate Kyuubi into third-party projects, e.g. Apache Bigtop, Apache Ambari.

Additional context

This is kind of an umbrella task since there are bunches of projects/tools that support Apache Hive, the maintainers/committers would classify your work into different levels based on the real efforts of project integration and promotion.

Introduction of https://github.com/apache/kyuubi/issues/6232

JiaLiangC commented 7 months ago

Dinky is a big data SQL workspace similar to Hue. I have verified the compatibility of the Kyuubi data source with Hive on Dinky, and I am currently working on the Kyuubi data source for Dinky. So, how should I go about creating a task?

pan3793 commented 7 months ago

@JiaLiangC If works are done in a third-party project repo, e.g. PR, articles, just add links here, if something needs to be done on Kyuubi's side, just open PR, all contributions that happen during the program dates will be counted.

thomasg19930417 commented 6 months ago

Datasophon integration with Apache Kyuubi ,link: https://github.com/datavane/datasophon/pull/435

apache / kyuubi