search

ClickHouse / spark-clickhouse-connector

Spark ClickHouse Connector build on DataSourceV2 API
https://clickhouse.com/docs/en/integrations/apache-spark
Apache License 2.0
187 stars 66 forks source link

Support to set ClickHouse insert settings when writing to a table #369

Open mzitnik opened 1 week ago

mzitnik commented 1 week ago

We can add custom settings to ClickHouse SQL when running an insert.

Example: INSERT INTO [table] SETTINGS [...]

Currently, there is no way to achieve this with the spark connector.

Maybe spark-clickhouse-connector can read settings starting with spark.clickhouse.write.settings. and apply them when write into clickhouse tables.