Spark 2.4.2 and Delta Lake

mesosphere / spark-build

Used to build the mesosphere/spark docker image and the DC/OS Spark package

52 stars 34 forks source link

Open ploddi opened 5 years ago

ploddi commented 5 years ago

Databricks open-sources Delta Lake recently. According to docs (https://docs.delta.io/latest/quick-start.html#set-up-apache-spark-with-delta) it requires Spark 2.4.2 or above.

Can you please release quick update to 2.4.2.

vishnu2kmohan commented 5 years ago

@ploddi Ack and thanks for the suggestions, we'll take this into consideration for our next update.

cc @samvantran @akirillov