When we set write-parallelism, if the parallelism of writing is different from the parallelism of tasks, iceberg write operator will be disconnected. In this case, distribution-mode: RANGE will have no effect.
We should throw this exception when the task jobgraph is generated
cc @stevenzwu @pvary
Willingness to contribute
[X] I can contribute a fix for this bug independently
[ ] I would be willing to contribute a fix for this bug with guidance from the Iceberg community
[ ] I cannot contribute a fix for this bug at this time
Apache Iceberg version
1.7.0 (latest release)
Query engine
Flink
Please describe the bug 🐞
When we set write-parallelism, if the parallelism of writing is different from the parallelism of tasks, iceberg write operator will be disconnected. In this case, distribution-mode: RANGE will have no effect.
We should throw this exception when the task jobgraph is generated
cc @stevenzwu @pvary
Willingness to contribute