Will Snowflake side support snowpipe_streaming method to ingest data to Snowflake table in Spark Connector?

snowflakedb / spark-snowflake

Snowflake Data Source for Apache Spark.

http://www.snowflake.net

Apache License 2.0

211 stars 98 forks source link

Will Snowflake side support snowpipe_streaming method to ingest data to Snowflake table in Spark Connector? #521

Open hbpeng0115 opened 1 year ago

hbpeng0115 commented 1 year ago

We want to use Spark to ingest data to Snowflake table. Currently Snowflake has official released snowpipe_streaming feature, I'm wondering whether Snowflake side has a plan to integrate it in Spark connector?