Closed saurabh81192 closed 1 year ago
The issue is because of the datetime datatype. SQL Server Datetime data type only allows 3 digits fractional seconds while spark dateframe might have more digits. Please try to use datetime2 for SQL column instead of datetime.
Below is the code which I am using. Do you think I am missing something here? The same code executes fine if I am using the write format as jdbc.
Getting below error
I have created a new cluster with the below configuration and only one library is installed in that cluster which is from maven coordinate - com.microsoft.azure:spark-mssql-connector_2.12:1.2.0
8 Worker nodes with 14GB memory and 4 cores. Databricks Runtime Version - 9.1 LTS (includes Apache Spark 3.1.2, scala 2.12).