search

Azure / azure-sqldb-spark

This project provides a client library that allows Azure SQL DB or SQL Server to act as an input source or output sink for Spark jobs.
MIT License
75 stars 52 forks source link

Make Spark dependency provided #70

Closed Fokko closed 4 years ago

Fokko commented 4 years ago

Currently, we're using the spark-sqldb-spark package with Spark 2.4. This works, but for the packaging, we have to exclude the Spark dependency from azure-sql-db. Generally, it is recommended to mark Spark provided when it comes to a plugin, so it can be used with different Spark versions as well. For example, they mark them as provided at CosmosDB as well: https://github.com/Azure/azure-cosmosdb-spark/blob/2.4/pom.xml#L51-L56

Fokko commented 4 years ago

@arvindshmicrosoft @romitgirdhar

arvindshmicrosoft commented 4 years ago

@Fokko thank you for your contribution. We have eyes on this, and appreciate your patience as we work through this and other backlog items.

Fokko commented 4 years ago

Thanks, let me know if there is anything unclear.