apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.46k stars 969 forks source link

[flink] Set default parallelism for sink in cases where AQE not supported #4221

Closed yunfengzhou-hub closed 2 months ago

yunfengzhou-hub commented 2 months ago

Purpose

This PR provides default parallelism configuration for sink operators, in cases where undefined/adaptive parallelism has not been supported.

Tests

Existing UTs are modified to verify that the cases mentioned above can function correctly now.

API and Format

No API or format is changed

Documentation

No documentation needed. The existing unsupported cases had not been documented, so no modification needed for documents.