Alluxio / alluxio

Alluxio, data orchestration for analytics and machine learning in the cloud
https://www.alluxio.io
Apache License 2.0
6.82k stars 2.93k forks source link

Build with hdfs failed #18600

Closed sunzhaoyang closed 1 month ago

sunzhaoyang commented 4 months ago
* (HEAD detached at v2.9.3)
  main

Refer to https://docs.alluxio.io/os/user/stable/en/contributor/Building-Alluxio-From-Source.html#build-different-hdfs-under-storage

mvn clean install -pl underfs/hdfs/   -Dmaven.javadoc.skip=true -DskipTests -Dlicense.skip=true   -Dcheckstyle.skip=true -Dfindbugs.skip=true   -Pufs-hadoop-3 -Dufs.hadoop.version=3.0.0-cdh6.3.2
[INFO]
[INFO] ------------------< org.alluxio:alluxio-underfs-hdfs >------------------
[INFO] Building Alluxio Under File System - HDFS 2.9.3
[INFO] --------------------------------[ jar ]---------------------------------
Downloading from HDPReleases: https://repo.hortonworks.com/content/repositories/releases/org/alluxio/alluxio-shaded-hadoop/3.0.0-cdh6.3.2/alluxio-shaded-hadoop-3.0.0-cdh6.3.2.pom
[WARNING] The POM for org.alluxio:alluxio-shaded-hadoop:jar:3.0.0-cdh6.3.2 is missing, no dependency information available
Downloading from HDPReleases: https://repo.hortonworks.com/content/repositories/releases/org/alluxio/alluxio-shaded-hadoop/3.0.0-cdh6.3.2/alluxio-shaded-hadoop-3.0.0-cdh6.3.2.jar
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 3.809 s
[INFO] Finished at: 2024-05-08T11:20:26Z
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project alluxio-underfs-hdfs: Could not resolve dependencies for project org.alluxio:alluxio-underfs-hdfs:jar:2.9.3: Failure to find org.alluxio:alluxio-shaded-hadoop:jar:3.0.0-cdh6.3.2 in https://repo1.maven.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException

Also tried

mvn clean install -pl underfs/hdfs/   -Dmaven.javadoc.skip=true -DskipTests -Dlicense.skip=true   -Dcheckstyle.skip=true -Dfindbugs.skip=true   -Pufs-hadoop-3 -Dufs.hadoop.version=3.0.0

and

image

got similar error

image

Actually , I can't find alluxio-shaded-hadoop and only alluxio-shaded-hadoop-client instead , how you guys make it work?

image

jasondrogba commented 4 months ago

First problem:

[ERROR] Failed to execute goal on project alluxio-underfs-hdfs: Could not resolve dependencies for project org.alluxio:alluxio-underfs-hdfs:jar:2.9.3: Failure to find org.alluxio:alluxio-shaded-hadoop:jar:3.0.0-cdh6.3.2 in https://repo1.maven.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced -> [Help 1]

you can look here.https://stackoverflow.com/questions/4856307/when-maven-says-resolution-will-not-be-reattempted-until-the-update-interval-of

sunzhaoyang commented 4 months ago

First problem:

[ERROR] Failed to execute goal on project alluxio-underfs-hdfs: Could not resolve dependencies for project org.alluxio:alluxio-underfs-hdfs:jar:2.9.3: Failure to find org.alluxio:alluxio-shaded-hadoop:jar:3.0.0-cdh6.3.2 in https://repo1.maven.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced -> [Help 1]

you can look here.https://stackoverflow.com/questions/4856307/when-maven-says-resolution-will-not-be-reattempted-until-the-update-interval-of

Thanks for your help. I tried and still not working ......

YichuanSun commented 1 month ago

Seems that the maven cannot download the jar, due to network problem? I'm not sure.

YichuanSun commented 1 month ago

Close it due to no response.