So basically I'm using spark thrift server to let users use pure sql to select data from hive + s3 storage using spark.
How do I select data from clickhouse using clickhouse-connector and THEN insert into Hive table?
like:
SET spark.sql.catalog.clickhouse.user=someuser;
SET spark.sql.catalog.clickhouse.user=somepassword;
use clickhouse;
So basically I'm using spark thrift server to let users use pure sql to select data from hive + s3 storage using spark. How do I select data from clickhouse using clickhouse-connector and THEN insert into Hive table? like: SET spark.sql.catalog.clickhouse.user=someuser; SET spark.sql.catalog.clickhouse.user=somepassword; use clickhouse;
then SELECT * FROM.
INSERT INTO.?