search

TOSIT-IO / tez

Tez TDP repository
https://tez.apache.org/
Apache License 2.0
0 stars 2 forks source link

Building tez-api 0.9.2-1.0 failed, can't download hadoop-hdfs-client-2.7.2.pom #7

Open rpignolet opened 7 months ago

rpignolet commented 7 months ago

When trying to build tez-api 0.9.2-1.0, I can't retrieve hadoop-hdfs-client-2.7.2.pom.

Command use to build:

mvn clean install -pl \!tez-ui -Phadoop28 -P\!hadoop27 -DskipTests

Outputs:

[INFO] -----------------------< org.apache.tez:tez-api >-----------------------
[INFO] Building tez-api 0.9.2-1.0                                        [3/28]
[INFO] --------------------------------[ jar ]---------------------------------
Downloading from apache.snapshots.https: https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-hdfs-client/2.7.2/hadoop-hdfs-client-2.7.2.pom
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for tez 0.9.2-1.0:
[INFO] 
[INFO] tez ................................................ SUCCESS [  0.602 s]
[INFO] hadoop-shim ........................................ SUCCESS [  0.521 s]
[INFO] tez-api ............................................ FAILURE [  0.180 s]
[INFO] tez-build-tools .................................... SKIPPED
[INFO] tez-common ......................................... SKIPPED
[INFO] tez-runtime-internals .............................. SKIPPED
[INFO] tez-runtime-library ................................ SKIPPED
[INFO] tez-mapreduce ...................................... SKIPPED
[INFO] tez-examples ....................................... SKIPPED
[INFO] tez-dag ............................................ SKIPPED
[INFO] tez-tests .......................................... SKIPPED
[INFO] tez-ext-service-tests .............................. SKIPPED
[INFO] tez-plugins ........................................ SKIPPED
[INFO] tez-protobuf-history-plugin ........................ SKIPPED
[INFO] tez-yarn-timeline-history .......................... SKIPPED
[INFO] tez-yarn-timeline-history-with-acls ................ SKIPPED
[INFO] tez-yarn-timeline-cache-plugin ..................... SKIPPED
[INFO] tez-yarn-timeline-history-with-fs .................. SKIPPED
[INFO] tez-history-parser ................................. SKIPPED
[INFO] tez-aux-services ................................... SKIPPED
[INFO] tez-tools .......................................... SKIPPED
[INFO] tez-perf-analyzer .................................. SKIPPED
[INFO] tez-job-analyzer ................................... SKIPPED
[INFO] tez-javadoc-tools .................................. SKIPPED
[INFO] hadoop-shim-impls .................................. SKIPPED
[INFO] hadoop-shim-2.8 .................................... SKIPPED
[INFO] tez-dist ........................................... SKIPPED
[INFO] Tez ................................................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  1.480 s
[INFO] Finished at: 2024-01-23T11:34:51Z
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project tez-api: Could not resolve dependencies for project org.apache.tez:tez-api:jar:0.9.2-1.0: Failed to collect dependencies at org.apache.hadoop:hadoop-hdfs-client:jar:2.7.2: Failed to read artifact descriptor for org.apache.hadoop:hadoop-hdfs-client:jar:2.7.2: Could not transfer artifact org.apache.hadoop:hadoop-hdfs-client:pom:2.7.2 from/to apache.snapshots.https (https://repository.apache.org/content/repositories/snapshots): Access denied to: https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-hdfs-client/2.7.2/hadoop-hdfs-client-2.7.2.pom , ReasonPhrase:Forbidden. -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :tez-api
rpignolet commented 7 months ago

ping @Pierrotws

rpignolet commented 7 months ago

The domain repository.apache.org was blacklisted in my test, I opened it.

The new output:

[INFO] -----------------------< org.apache.tez:tez-api >-----------------------
[INFO] Building tez-api 0.9.2-1.0                                        [3/28]
[INFO] --------------------------------[ jar ]---------------------------------
[WARNING] The POM for org.apache.hadoop:hadoop-hdfs-client:jar:2.7.2 is missing, no dependency information available
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for tez 0.9.2-1.0:
[INFO] 
[INFO] tez ................................................ SUCCESS [  0.561 s]
[INFO] hadoop-shim ........................................ SUCCESS [  0.596 s]
[INFO] tez-api ............................................ FAILURE [  0.042 s]
[INFO] tez-build-tools .................................... SKIPPED
[INFO] tez-common ......................................... SKIPPED
[INFO] tez-runtime-internals .............................. SKIPPED
[INFO] tez-runtime-library ................................ SKIPPED
[INFO] tez-mapreduce ...................................... SKIPPED
[INFO] tez-examples ....................................... SKIPPED
[INFO] tez-dag ............................................ SKIPPED
[INFO] tez-tests .......................................... SKIPPED
[INFO] tez-ext-service-tests .............................. SKIPPED
[INFO] tez-plugins ........................................ SKIPPED
[INFO] tez-protobuf-history-plugin ........................ SKIPPED
[INFO] tez-yarn-timeline-history .......................... SKIPPED
[INFO] tez-yarn-timeline-history-with-acls ................ SKIPPED
[INFO] tez-yarn-timeline-cache-plugin ..................... SKIPPED
[INFO] tez-yarn-timeline-history-with-fs .................. SKIPPED
[INFO] tez-history-parser ................................. SKIPPED
[INFO] tez-aux-services ................................... SKIPPED
[INFO] tez-tools .......................................... SKIPPED
[INFO] tez-perf-analyzer .................................. SKIPPED
[INFO] tez-job-analyzer ................................... SKIPPED
[INFO] tez-javadoc-tools .................................. SKIPPED
[INFO] hadoop-shim-impls .................................. SKIPPED
[INFO] hadoop-shim-2.8 .................................... SKIPPED
[INFO] tez-dist ........................................... SKIPPED
[INFO] Tez ................................................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  1.368 s
[INFO] Finished at: 2024-01-23T11:49:10Z
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project tez-api: Could not resolve dependencies for project org.apache.tez:tez-api:jar:0.9.2-1.0: Failure to find org.apache.hadoop:hadoop-hdfs-client:jar:2.7.2 in https://repository.apache.org/content/repositories/snapshots was cached in the local repository, resolution will not be reattempted until the update interval of apache.snapshots.https has elapsed or updates are forced -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :tez-api
rpignolet commented 7 months ago

Adding a -U to the build command for the the update interval of apache.snapshots.https has elapsed or updates are forced error.

mvn clean install -U -pl \!tez-ui -Phadoop28 -P\!hadoop27 -DskipTests
[INFO] -----------------------< org.apache.tez:tez-api >-----------------------
[INFO] Building tez-api 0.9.2-1.0                                        [3/28]
[INFO] --------------------------------[ jar ]---------------------------------
Downloading from apache.snapshots.https: https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-hdfs-client/2.7.2/hadoop-hdfs-client-2.7.2.pom
Downloading from central: https://repo.maven.apache.org/maven2/org/apache/hadoop/hadoop-hdfs-client/2.7.2/hadoop-hdfs-client-2.7.2.pom
[WARNING] The POM for org.apache.hadoop:hadoop-hdfs-client:jar:2.7.2 is missing, no dependency information available
Downloading from apache.snapshots.https: https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-hdfs-client/2.7.2/hadoop-hdfs-client-2.7.2.jar
Downloading from central: https://repo.maven.apache.org/maven2/org/apache/hadoop/hadoop-hdfs-client/2.7.2/hadoop-hdfs-client-2.7.2.jar
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for tez 0.9.2-1.0:
[INFO] 
[INFO] tez ................................................ SUCCESS [  0.547 s]
[INFO] hadoop-shim ........................................ SUCCESS [  0.547 s]
[INFO] tez-api ............................................ FAILURE [  0.730 s]
[INFO] tez-build-tools .................................... SKIPPED
[INFO] tez-common ......................................... SKIPPED
[INFO] tez-runtime-internals .............................. SKIPPED
[INFO] tez-runtime-library ................................ SKIPPED
[INFO] tez-mapreduce ...................................... SKIPPED
[INFO] tez-examples ....................................... SKIPPED
[INFO] tez-dag ............................................ SKIPPED
[INFO] tez-tests .......................................... SKIPPED
[INFO] tez-ext-service-tests .............................. SKIPPED
[INFO] tez-plugins ........................................ SKIPPED
[INFO] tez-protobuf-history-plugin ........................ SKIPPED
[INFO] tez-yarn-timeline-history .......................... SKIPPED
[INFO] tez-yarn-timeline-history-with-acls ................ SKIPPED
[INFO] tez-yarn-timeline-cache-plugin ..................... SKIPPED
[INFO] tez-yarn-timeline-history-with-fs .................. SKIPPED
[INFO] tez-history-parser ................................. SKIPPED
[INFO] tez-aux-services ................................... SKIPPED
[INFO] tez-tools .......................................... SKIPPED
[INFO] tez-perf-analyzer .................................. SKIPPED
[INFO] tez-job-analyzer ................................... SKIPPED
[INFO] tez-javadoc-tools .................................. SKIPPED
[INFO] hadoop-shim-impls .................................. SKIPPED
[INFO] hadoop-shim-2.8 .................................... SKIPPED
[INFO] tez-dist ........................................... SKIPPED
[INFO] Tez ................................................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  1.993 s
[INFO] Finished at: 2024-01-23T11:51:52Z
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project tez-api: Could not resolve dependencies for project org.apache.tez:tez-api:jar:0.9.2-1.0: Could not find artifact org.apache.hadoop:hadoop-hdfs-client:jar:2.7.2 in apache.snapshots.https (https://repository.apache.org/content/repositories/snapshots) -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :tez-api
SteBaum commented 7 months ago

The issue has been solved. The hadoop version in the pom.xml has been changed from 2.7.2 to 3.1.1-0.0.