Closed ShubhamG25 closed 1 year ago
Oh, wild. "D" is a suffix meaning "double" in Java, and "F" means float. "E" is of course a way to specify scientific notation. So "8E9D" works as 8.0 x 10^9. I wonder what we want to support here. Not "D" and "F" suffixes I think. I could imagine supporting "9.3E-3" or something as a double. OK I can change that
Thanks @srowen for the quick fix. I believe the changes will start reflecting in next release.
Hi ,
I am trying to generate the schema from a complex XML column in pyspark dataframe using the function below.
When trying to generate the schema with the field value '8E9N' data type returned as StringType but when trying with value that ends with letter 'D' or 'F' (exa - '8E9D', '8E8F') datatype returned as DoubleType . Ideally it should also be treated as StringType.
Kindly find attached the screenshot and code to reproduce the issue.