Doesn't work with Spark 3.0

Azure / azure-sqldb-spark

This project provides a client library that allows Azure SQL DB or SQL Server to act as an input source or output sink for Spark jobs.

MIT License

76 stars 52 forks source link

Doesn't work with Spark 3.0 #83

Closed rajkve closed 4 years ago

rajkve commented 4 years ago

This connector doesn't work with Spark 3.0 (SCALA 12) -

Error message: Invalid scala product class

arvindshmicrosoft commented 4 years ago

Thank you for your question. This is a duplicate of #80 - repeating the text from that issue:

There are no plans to support Spark 3.0.0 with this connector. Consider evaluating the Apache Spark Connector for SQL Server and Azure SQL which is a newer connector. They are already tracking the request for Spark 3.0.0 support in the new connector.

I am closing this issue as there are no plans to address this request in this connector.

rajkve commented 4 years ago

Hi - I am not quite sure if using this connector is an option, based on our performance testing - this connector is 4X slower for the same configuration