Add amoro shade dependencies

zhoujinsong commented 3 weeks ago

Why are the changes needed?

We created a separate repo to shade some dependencies of the Amoro project:https://github.com/apache/amoro-shade This PR adds dependencies on them.

Brief change log

Add dependencies on the amoro shade project.

How was this patch tested?

[ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
[ ] Add screenshots for manual tests if appropriate
[x] Run test locally before making a pull request

Documentation

Does this pull request introduce a new feature? (no)
If yes, how is the feature documented? (not applicable)

daragu commented 3 weeks ago

It takes longer to download these dependencies during building the project.

zhoujinsong commented 3 weeks ago

It takes longer to download these dependencies during building the project.

Thanks for the reporting. The new snapshot shade jars are only available on the Apache snapshot repository and the download speed is low sometimes.

The situation will be quite better when we release 0.7.0 and we will replay on release jars. You can try to install the snapshot jars manually to speed up the build process.

daragu commented 3 weeks ago

@zhoujinsong, ok, but it cost 1h after patch.

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Amoro Project Parent 0.7-SNAPSHOT:
[INFO] 
[INFO] Amoro Project Parent ............................... SUCCESS [  1.291 s]
[INFO] Amoro Project Core ................................. SUCCESS [  8.571 s]
[INFO] Amoro Project AMS Parent ........................... SUCCESS [  0.068 s]
[INFO] Amoro Project AMS API .............................. SUCCESS [  2.243 s]
[INFO] Amoro Project Mixed Format Parent .................. SUCCESS [  0.055 s]
[INFO] Amoro Project Mixed Hive Format .................... SUCCESS [ 11.623 s]
[INFO] Amoro Project AMS Dashboard ........................ SUCCESS [  0.108 s]
[INFO] Amoro Project Mixed Format Spark Parent ............ SUCCESS [  0.038 s]
[INFO] Amoro Project Mixed Format Spark 3 Common .......... SUCCESS [  6.610 s]
[INFO] Amoro Project Mixed Format Spark 3.3 ............... SUCCESS [ 29.344 s]
[INFO] Amoro Project AMS Optimizer Parent ................. SUCCESS [  0.036 s]
[INFO] Amoro Project AMS Optimizer Common ................. SUCCESS [  0.300 s]
[INFO] Amoro Project AMS Standalone Optimizer ............. SUCCESS [  0.108 s]
[INFO] Amoro Project AMS Server ........................... SUCCESS [ 11.491 s]
[INFO] Amoro Project AMS Flink Optimizer .................. SUCCESS [01:53 min]
[INFO] Amoro Project AMS Spark Optimizer .................. SUCCESS [ 35.009 s]
[INFO] Amoro Project AMS Metric Reporter Parent ........... SUCCESS [  0.038 s]
[INFO] Amoro Project AMS Prometheus Reporter .............. SUCCESS [  1.387 s]
[INFO] Amoro Project AMS Dist ............................. SUCCESS [  7.515 s]
[INFO] Amoro Project Mixed Format Flink Parent ............ SUCCESS [  0.032 s]
[INFO] Amoro Project Mixed Format Flink Iceberg Bridge .... SUCCESS [ 10.349 s]
[INFO] Amoro Project Mixed Format Flink Common Format ..... SUCCESS [  0.144 s]
[INFO] Amoro Project Mixed Format Flink Common ............ SUCCESS [  5.717 s]
[INFO] Amoro Project Mixed Format Flink 1.15 .............. SUCCESS [  0.694 s]
[INFO] Amoro Project Mixed Format Flink 1.15 Runtime ...... SUCCESS [06:04 min]
[INFO] Amoro Project Mixed Format Flink 1.16 .............. SUCCESS [  0.724 s]
[INFO] Amoro Project Mixed Format Flink 1.16 Runtime ...... SUCCESS [  01:00 h]
[INFO] Amoro Project Mixed Format Flink 1.17 .............. SUCCESS [  0.360 s]
[INFO] Amoro Project Mixed Format Flink 1.17 Runtime ...... SUCCESS [02:11 min]
[INFO] Amoro Project Mixed Format Spark 3.2 ............... SUCCESS [ 21.161 s]
[INFO] Amoro Project Mixed Format Spark 3.2 Runtime ....... SUCCESS [04:53 min]
[INFO] Amoro Project Mixed Format Spark 3.3 Runtime ....... SUCCESS [02:26 min]
[INFO] Amoro Project Mixed Format Trino ................... SUCCESS [01:44 min]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  01:22 h
[INFO] Finished at: 2024-06-13T15:01:59+08:00
[INFO] ------------------------------------------------------------------------

zhoujinsong commented 3 weeks ago

@zhoujinsong, ok, but it cost 1h after patch.

Sorry to hear that :( There is no obvious impact on my environment. I think this should have a lot to do with the network environment. Then I strongly suggest you comment on the apache snapshot repo information in the pom.xml and install the shade jars manually.

daragu commented 3 weeks ago

@zhoujinsong, ok, but it cost 1h after patch.

Sorry to hear that :( There is no obvious impact on my environment. I think this should have a lot to do with the network environment. Then I strongly suggest you comment on the apache snapshot repo information in the pom.xml and install the shade jars manually.

ok, will try again.

apache / amoro