.format("com.microsoft.sqlserver.jdbc.spark") does not work on Azure Databricks Spark 3.2+

microsoft / sql-spark-connector

Apache Spark Connector for SQL Server and Azure SQL

Apache License 2.0

273 stars 118 forks source link

.format("com.microsoft.sqlserver.jdbc.spark") does not work on Azure Databricks Spark 3.2+ #233

Open Git-BT-Hub opened 1 year ago

Git-BT-Hub commented 1 year ago

Hi All, Below does not work on Azure Databricks Spark 3.2+ (DBR 12.1 LTS and above)

df.write \ .format("com.microsoft.sqlserver.jdbc.spark") \

Error: Py4JJavaError: An error occurred while calling o934.save. : java.lang.NoSuchMethodError: org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils$.getSchema(Ljava/sql/ResultSet;Lorg/apache/spark/sql/jdbc/JdbcDialect;Z)Lorg/apache/spark/sql/types/StructType;

Thanks