Result of the TD queries are being saved in the pandas DF, the null is being converted to NaT

GoogleCloudPlatform / professional-services-data-validator

Utility to compare data between homogeneous or heterogeneous environments to ensure source and target tables match

Apache License 2.0

394 stars 110 forks source link

Result of the TD queries are being saved in the pandas DF, the null is being converted to NaT #426

Open srikanthgaddam2 opened 2 years ago

srikanthgaddam2 commented 2 years ago

Suspect something similar to this issue for Hive: https://github.com/GoogleCloudPlatform/professional-services-data-validator/pull/406

srikanthgaddam2 commented 2 years ago

Issue is happening for both columns with datatypes of date and string fields if the value is null...for strings it is passing as 'None' and for Datetime it is passing as 'NaT'