I was wondering if it is possible to have a behavior like Dynamic Typing that performs the transformation from string to other data types only if the entire row can be converted to this data type.
Reasoning:
The following TSV:
Will be converted to:
However, this now has 2 different datatypes for a single column, which can cause issues in further pipeline steps, this is not easy to see specially if the dataset is huge.
Is there a way to Dynamic Typing only if the entire column can be converted to such datatype? Otherwise, is there a way to see what datatypes a column has?
I was wondering if it is possible to have a behavior like Dynamic Typing that performs the transformation from string to other data types only if the entire row can be converted to this data type.
Reasoning:
The following TSV:
Will be converted to:
However, this now has 2 different datatypes for a single column, which can cause issues in further pipeline steps, this is not easy to see specially if the dataset is huge.
Is there a way to Dynamic Typing only if the entire column can be converted to such datatype? Otherwise, is there a way to see what datatypes a column has?