apache / inlong

Apache InLong - a one-stop, full-scenario integration framework for massive data
https://inlong.apache.org/
Apache License 2.0
1.4k stars 530 forks source link

[Feature][Tool] Support parallel compilation and packaging #7784

Open featzhang opened 1 year ago

featzhang commented 1 year ago

There are two problems with the current project:

  1. When using mvn -B or mvnd to compile the project, various problems will occur and the compilation will fail.
  2. The CR pipeline runs too slowly

To locate the above problem, the analysis is as follows:

  1. Reasons why parallel packaging cannot be done

The inlong-distribution module uses assembly to compress and package the output of each module together. However, the module dependencies are not clearly specified in the pom file, causing maven to infer dependencies.

  1. CR pipeline does not need to generate distribution

Transformation method:

At present, it is being transformed to support multiple versions of Sort Flink, and it is also necessary to clarify the maven coordinates of each Connector

github-actions[bot] commented 1 year ago

This issue is stale because it has been open for 60 days with no activity.

github-actions[bot] commented 1 year ago

This issue is stale because it has been open for 60 days with no activity.