Currently if users want to write only partial columns into StarRock, need to specify sink.properties.columns to tell the column names of these partial columns, but it's actually not necessary because users already define these columns when creating a flink table, and the connector can get those information from the table schema.
This PR contains these improvements
infer whether it's partial write by comparing the schemas between Flink and StarRocks
if it's partial write, the connector will set sink.properties.columns automatically, otherwise this parameter can be omitted
Checklist:
[x] I have added test cases for my bug fix or my new feature
[ ] This pr will affect users' behaviors
[ ] This pr needs user documentation (for new or modified features or behaviors)
[ ] I have added documentation for my new feature or new function
What type of PR is this:
Which issues of this PR fixes :
Fixes #
Problem Summary(Required) :
Currently if users want to write only partial columns into StarRock, need to specify
sink.properties.columns
to tell the column names of these partial columns, but it's actually not necessary because users already define these columns when creating a flink table, and the connector can get those information from the table schema. This PR contains these improvementssink.properties.columns
automatically, otherwise this parameter can be omittedChecklist: