Open prithvikannan opened 1 year ago
Signed-off-by: Prithvi Kannan prithvi.kannan@databricks.com
detectDimensionTypes does not handle null values in the first row. This PR implements the following logic to determine dimension types based on the entire dataset: if all non-null values are numbers, then it's a number, otherwise it's a string
detectDimensionTypes
null
Signed-off-by: Prithvi Kannan prithvi.kannan@databricks.com
detectDimensionTypesdoes not handlenullvalues in the first row. This PR implements the following logic to determine dimension types based on the entire dataset: if all non-null values are numbers, then it's a number, otherwise it's a string