[DRAFT][CELEBORN-1490][CIP-6] Support Flink hybrid shuffle integration with Apache Celeborn

[codenohup]

What changes were proposed in this pull request?

Support Flink hybrid shuffle integration with Apache Celeborn

Why are the changes needed?

Implements CIP-6

Does this PR introduce any user-facing change?

No

How was this patch tested?

IT

---

The authorship belong to me and @reswqa @TanYuxin-tyx

[mridulm]

+CC @venkata91

[codecov[bot]]

Codecov Report

Attention: Patch coverage is 6.54206% with 100 lines in your changes missing coverage. Please review.

Project coverage is 33.17%. Comparing base (ea6617c) to head (7d0cd40). Report is 24 commits behind head on main.

Files	Patch %	Lines
...a/org/apache/celeborn/common/meta/MapFileMeta.java	0.00%	43 Missing :warning:
.../common/network/protocol/SubPartitionReadData.java	0.00%	18 Missing :warning:
...org/apache/celeborn/common/util/PbSerDeUtils.scala	0.00%	15 Missing :warning:
...born/common/protocol/message/ControlMessages.scala	0.00%	13 Missing :warning:
...cala/org/apache/celeborn/common/CelebornConf.scala	0.00%	6 Missing :warning:
...ache/celeborn/common/network/protocol/Message.java	57.15%	3 Missing :warning:
...born/common/network/protocol/TransportMessage.java	0.00%	2 Missing :warning:

Additional details and impacted files

```diff @@ Coverage Diff @@ ## main #2678 +/- ## ========================================== - Coverage 39.83% 33.17% -6.66% ========================================== Files 239 311 +72 Lines 15026 18323 +3297 Branches 1362 1681 +319 ========================================== + Hits 5984 6076 +92 - Misses 8711 11907 +3196 - Partials 331 340 +9 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

[codenohup]

We need to split this PR into multiple smaller commits to facilitate the review process. Therefore, we will close this PR now. 🤧