[Umbrella] Suppors LakeSoul integration

[SteNicholas]

Code of Conduct

• [X] I agree to follow this project's Code of Conduct

Search before asking

• [X] I have searched in the issues and found no similar issues.

Describe the proposal

LakeSoul implements incremental upserts for both row and column and allows concurrent updates. LakeSoul uses LSM-Tree like structure to support updates on hash partitioning table with primary key, and achieve very high write throughput (30MB/s/core) on cloud object store like S3 while providing optimized merge on read performance. LakeSoul scales metadata management and achieves ACID control by using PostgreSQL. LakeSoul provides tools to ingest CDC and log streams automatically in a zero-ETL style. Kyuubi could support the integration with LakeSoul.

Task list

Suppors LakeSoul integration.

Are you willing to submit PR?

• [ ] Yes. I would be willing to submit a PR with guidance from the Kyuubi community to improve.
• [X] No. I cannot submit a PR at this time.

[Asakiny]

Hi, @SteNicholas LakeSoul can be integrated in Kyuubi now, both support Spark and Flink SQL Query Engine.

Please refer to : https://lakesoul-io.github.io/docs/Usage%20Docs/setup-kyuubi,

Maybe we could add docs to Kyuubi.

[SteNicholas]

@Asakiny, could you add document of LakeSoul integration in Kyuubi docs?