I'm always frustrated when there are new data types in source schema. Because of the new data types coming, sometimes the project cannot successfully convert the source data to target data format (like parquet).
For example:
Possible solution
It is better to delete this hardcode cdmTypeMap. And add the configuration to yaml, so that we can add new data types to yaml by ourselves in the future.
Description
I'm always frustrated when there are new data types in source schema. Because of the new data types coming, sometimes the project cannot successfully convert the source data to target data format (like parquet).
For example:
Possible solution
It is better to delete this hardcode
cdmTypeMap. And add the configuration to yaml, so that we can add new data types to yaml by ourselves in the future.Thank you very much! :)
Alternatives
No response
Context
No response