Azure-Samples / modern-data-warehouse-dataops

DataOps for the Modern Data Warehouse on Microsoft Azure. https://aka.ms/mdw-dataops.
MIT License
570 stars 451 forks source link

Alter a notebook to be able to query INT64 fields (date time fields) from the Delta Lake on the Serverless Sample #577

Closed ydaponte closed 1 year ago

ydaponte commented 1 year ago

Test if the problem happens before the conversion to delta (parquet format). Datetime fields are tpep_pickup_datetime and tpep_dropoff_datetime.

Success criteria:

ydaponte commented 1 year ago

On December 14th, a new release was announced for Synapse and Delta Lake - seems that this versions corrected the problem.