Closed Ivan-gfan closed 4 months ago
The problem is with physicColumn.of
in the FieldMapper class under the Transform module, which leaves the sourceType empty, which I have modified on the Intranet
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.
Search before asking
What happened
When I synchronized from MySQL to MySQL, fieldMapper of transform was added, and when
schema_save_mode = "CREATE_SCHEMA_WHEN_NOT_EXIST"
was configured at the sink, an error occurred in the automatic table creation function, and all field types were null.The following DDL statements are viewed in the log
I traced the code and found that there was a judgment in the
MysqlCreateTableSqlBuilder
class to determine if the previous catalogname was the current mysql, and if so, get the column.getSourceType, but the sourceType attribute is null, which causes this errorI tracked the code further and found that when sink was built(Class
MultipleTableJobConfigParser#parseSink
), there was atableWithActionMap
parameter, which stored the field structure of the source side and the field structure of transform, and the sourceType of the field structure of transform was nullIt is not clear for the time being whether such a result should be obtained. Now I have only tracked it here, please help to see where the problem occurred
From this point of view, this error should not occur only from mysql to mysql, but if the source side and the target side are of the same type, and there is a transform fieldmapper, the same error will occur
SeaTunnel Version
2.3.4
SeaTunnel Config
Running Command
Error Exception
Zeta or Flink or Spark Version
No response
Java or Scala Version
jdk1.8
Screenshots
No response
Are you willing to submit PR?
Code of Conduct