search

microsoft / sql-spark-connector

Apache Spark Connector for SQL Server and Azure SQL
Apache License 2.0
273 stars 118 forks source link

GA versions #245

Open jsilveira7 opened 11 months ago

jsilveira7 commented 11 months ago

Currently this connector is only available on GA for spark 3.1 but not onwards...

However, currently some supported tools from Microsoft for example Synapse, the spark 3.1 pools have a end of lifetime in Jan24 therefore currently who works with Synapse and has integrations with sql servers using this connector only have 2 months left.

This is a major impact in a lot of users and therefore, I request to understand when will spark 3.3 will be available not only on beta version but on GA.

### Tasks
brampostma commented 11 months ago

Same goes for Azure Databricks where the only Databricks Runtime (DBR) with Spark 3.1 is "9.1" which is the oldest still supported DBR by databricks and it will no longer be supported starting september next year. But next to that new Features like Unity Catalog are not compatible with DBR "9.1" and thus the same question as jsilveira7

kthejoker commented 9 months ago

@shivsood any timelines you can share? This is becoming a blocker at Microsoft customers.