search

ClickHouse / spark-clickhouse-connector

Spark ClickHouse Connector build on DataSourceV2 API
https://clickhouse.com/docs/en/integrations/apache-spark
Apache License 2.0
187 stars 66 forks source link

Support to set ClickHouse query settings when reading table #272

Open zhouyifan279 opened 1 year ago

zhouyifan279 commented 1 year ago

We can add settings to ClickHouse SQL when using ClickHouse client. For example:

SELECT * FROM replacing_merge_tree_table SETTINGS final=1;

Currently, there is not way to achieve this in clickhouse-connector.

Maybe clickhouse-connector can read settings starting with spark.clickhouse.settings. and apply them when read/write clickhouse tables.