Add support for Spark Datasource API v2

ZuInnoTe / spark-hadoopcryptoledger-ds

A Spark datasource for the HadoopCryptoLedger library

Apache License 2.0

13 stars 3 forks source link

Open jornfranke opened 6 years ago

jornfranke commented 6 years ago

Since Spark 2.3.0 (https://spark.apache.org/releases/spark-release-2-3-0.html) a new datasource API v2 is available (experimental).

We should add support in addition to the v1 API.

jornfranke commented 4 years ago

Spark 3.0.0 is coming soon and we will release also an initial v2 support despite that v1 is still supported in Spark 3