apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.27k stars 909 forks source link

[Feature] Are there plans to support ClickHouse? #3810

Open xleoken opened 1 month ago

xleoken commented 1 month ago

Search before asking

Motivation

Apache Paimon is a streaming data lake platform.We are currently using ClickHouse and Apache Paimon.We are currently reading the data in Apache Paimon to ClickHouse for OLAP analysis through the Apache Flink stream. If ClickHouse can directly query the data in Apache Paimon as a federated query platform for the Paimon data lake, it will enable the construction of streams based on Apache Paimon. The type of lake warehouse has become much simpler. Does paimon have a plan to support ClickHouse?

Solution

No response

Anything else?

No response

Are you willing to submit a PR?

charlesy6 commented 1 month ago

+1

daragu commented 1 month ago

+1

xuzifu666 commented 1 month ago

It may need ClickHouse engine to support querying paimon not paimon self,but ClickHouse had not support it. You maybe can use other olap engine which had support paimon in exeternal table query,such as StarRocks,Trino. @xleoken @daragu @charlesy6