Azure-Samples / modern-data-warehouse-dataops

DataOps for Microsoft Data Platform technologies. https://aka.ms/dataops-repo
MIT License
594 stars 463 forks source link

Alter a notebook to be able to query INT64 fields (date time fields) from the Delta Lake on the Serverless Sample #577

Closed ydaponte closed 1 year ago

ydaponte commented 1 year ago

Test if the problem happens before the conversion to delta (parquet format). Datetime fields are tpep_pickup_datetime and tpep_dropoff_datetime.

Success criteria:

ydaponte commented 1 year ago

On December 14th, a new release was announced for Synapse and Delta Lake - seems that this versions corrected the problem.