Open m4rcs opened 9 months ago
I'm experiencing this same issue/error with a Standard SQL Server and datetime2(0) only, other precisions work as normal. Changing the data type to datetime works around the issue, but appears this is missing in the bulk driver for multiple connection types
I run into a problem when writing TIMESTAMP data from Databricks to Azure Synapse datetime2 columns using this driver. I tested it with the driver for Spark 3.1, 3.3 and 3.4. In every environment it fails with this error message:
Further down I provide the complete error message.
Can you help me get this fixed? Did I miss some configuration?
Test Setup
This is the minimal example that I created to help debugging it. It's just one column and row that contains one timestamp that should be exported to a Synapse table that contains only a datetime2 column.
Databricks Notebook
dbt.d_test_t
Schema in SynapseError Message