Spark Exasol Connector
Overview
Spark Exasol Connector (SEC) supports an integration between Exasol and Apache Spark. It allows creating Spark DataFrame from Exasol queries and saving Spark DataFrame as an Exasol table.
Features
- Creates Spark DataFrame from Exasol query results
- Saves Spark DataFrame to an Exasol table
- Allows configuring the Spark tasks for parallel connection
- Supports Spark DataFrame column pruning and filter push down
Spark Streaming
At the moment, Spark Exasol Connector does not support integration with Spark Streaming. Please check out the Spark regular JDBC integration.