search

dd010101 / vyos-jenkins

How build packages from VyOS stable branches (1.3 equuleus/1.4 sagitta) with Jenkins (and then build ISO from them)
92 stars 30 forks source link

linux-kernel fetch failed & some others issues caused Jenkins task failed. #53

Closed MaurUppi closed 1 month ago

MaurUppi commented 1 month ago

Need a recommendation for a mirror in China for "https://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git." I tried several times, and all packages were built successfully on 7-build-project-jobs.sh phase BUT only Linux-kernel package.

Then, I tried to add the change below but it did not help.

image

17:31:57  Receiving objects:  40% (8941/21932), 528.93 MiB | 1.37 MiB/s
17:31:57  Receiving objects:  41% (8993/21932), 530.15 MiB | 1.32 MiB/s
17:31:57  Receiving objects:  41% (9036/21932), 532.12 MiB | 1.29 MiB/s
17:31:57  Receiving objects:  41% (9040/21932), 532.67 MiB | 1.25 MiB/s
17:31:57  Receiving objects:  41% (9185/21932), 534.30 MiB | 1.30 MiB/s
17:31:57  Receiving objects:  41% (9211/21932), 535.81 MiB | 1.38 MiB/s
17:31:57  Receiving objects:  42% (9212/21932), 535.81 MiB | 1.38 MiB/s
17:31:57  error: RPC failed; curl 56 GnuTLS recv error (-9): Error decoding the received TLS packet.
[17](http://192.168.1.124:8080/job/linux-kernel/job/sagitta/lastFailedBuild/pipeline-console/?start-byte=0&selected-node=75#log-17):31:57  error: 5613 bytes of body are still expected
17:31:57  fetch-pack: unexpected disconnect while reading sideband packet
17:31:57  fatal: early EOF
17:31:57  fatal: fetch-pack: invalid index-pack output
17:31:57  
17:31:57    at PluginClassLoader for git-client//org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:2846)
17:31:57    at PluginClassLoader for git-client//org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:2[18](http://192.168.1.124:8080/job/linux-kernel/job/sagitta/lastFailedBuild/pipeline-console/?start-byte=0&selected-node=75#log-18)5)
17:31:57    at PluginClassLoader for git-client//org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:635)
17:31:57    at PluginClassLoader for git-client//org.jenkinsci.plugins.gitclient.CliGitAPIImpl$2.execute(CliGitAPIImpl.java:871)
17:31:57    at PluginClassLoader for git//hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:12[20](http://192.168.1.124:8080/job/linux-kernel/job/sagitta/lastFailedBuild/pipeline-console/?start-byte=0&selected-node=75#log-20))
17:31:57    at PluginClassLoader for git//hudson.plugins.git.GitSCM._checkout(GitSCM.java:1310)
17:31:57    at PluginClassLoader for git//hudson.plugins.git.GitSCM.checkout(GitSCM.java:1277)
17:31:57    at PluginClassLoader for workflow-scm-step//org.jenkinsci.plugins.workflow.steps.scm.SCMStep.checkout(SCMStep.java:136)
17:31:57    at PluginClassLoader for workflow-scm-step//org.jenkinsci.plugins.workflow.steps.scm.SCMStep$StepExecutionImpl.run(SCMStep.java:101)
17:31:57    at PluginClassLoader for workflow-scm-step//org.jenkinsci.plugins.workflow.steps.scm.SCMStep$StepExecutionImpl.run(SCMStep.java:88)
17:31:57    at PluginClassLoader for workflow-step-api//org.jenkinsci.plugins.workflow.steps.SynchronousNonBlockingStepExecution.lambda$start$0(SynchronousNonBlockingStepExecution.java:47)
17:31:57    at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
17:31:57    at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:[26](http://192.168.1.124:8080/job/linux-kernel/job/sagitta/lastFailedBuild/pipeline-console/?start-byte=0&selected-node=75#log-26)4)
17:31:57    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
17:31:57    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
17:31:57    at java.base/java.lang.Thread.run(Thread.java:840)
17:31:57  ERROR: Error cloning remote repo 'origin'
17:31:57  ERROR: Maximum checkout retry attempts reached, aborting
Error cloning remote repo 'origin'
MaurUppi commented 1 month ago

Then, I tried to change the build script of the replay of the failed task. Then, Run again. However, it failed again.

change URL from https://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git TO https://mirrors.tuna.tsinghua.edu.cn/git/linux-firmware.git

   // Firmware
    ['name': 'linux-firmware', 'scmCommit': '20231211',
     'scmUrl': 'https://mirrors.tuna.tsinghua.edu.cn/git/linux-firmware.git',
     'buildCmd': 'cd ..; ./build-linux-firmware.sh'],
Details

``` Started by user admin Replayed #7 > git rev-parse --resolve-git-dir /var/lib/jenkins/caches/git-9294da01783858feecc2da493280ed38/.git # timeout=10 Setting origin to https://github.com/dd010101/vyos-build.git > git config remote.origin.url https://github.com/dd010101/vyos-build.git # timeout=10 Fetching origin... Fetching upstream changes from origin > git --version # timeout=10 > git --version # 'git version 2.39.5' > git config --get remote.origin.url # timeout=10 > git fetch --tags --force --progress -- origin +refs/heads/*:refs/remotes/origin/* # timeout=10 Seen branch in repository origin/current Seen branch in repository origin/equuleus Seen branch in repository origin/sagitta Seen 3 remote branches Obtained packages/linux-kernel/Jenkinsfile from 549e7920dba8e801b405169ab0d03da52f2285ff Loading library vyos-build@sagitta Attempting to resolve sagitta from remote references... > git --version # timeout=10 > git --version # 'git version 2.39.5' > git ls-remote -h -- https://github.com/dd010101/vyos-build.git # timeout=10 Found match: refs/heads/sagitta revision 549e7920dba8e801b405169ab0d03da52f2285ff The recommended git tool is: git No credentials specified > git rev-parse --resolve-git-dir /var/lib/jenkins/workspace/linux-kernel_sagitta@libs/ba775b0b95af8dc714063b9e81a4009bd1e2fa2f5ee616b46c4b8ba44d8366cc/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://github.com/dd010101/vyos-build.git # timeout=10 Fetching without tags Fetching upstream changes from https://github.com/dd010101/vyos-build.git > git --version # timeout=10 > git --version # 'git version 2.39.5' > git fetch --no-tags --force --progress -- https://github.com/dd010101/vyos-build.git +refs/heads/*:refs/remotes/origin/* # timeout=10 Checking out Revision 549e7920dba8e801b405169ab0d03da52f2285ff (sagitta) > git config core.sparsecheckout # timeout=10 > git checkout -f 549e7920dba8e801b405169ab0d03da52f2285ff # timeout=10 Commit message: "Merge branch 'vyos:sagitta' into sagitta" > git rev-list --no-walk 549e7920dba8e801b405169ab0d03da52f2285ff # timeout=10 [Pipeline] Start of Pipeline [Pipeline] timeout Timeout set to expire in 4 hr 0 min [Pipeline] { [Pipeline] timestamps [Pipeline] { [Pipeline] stage [Pipeline] { (Define Agent) [Pipeline] node [2024-09-21T10:05:59.338Z] Running on Jenkins in /var/lib/jenkins/workspace/linux-kernel_sagitta [Pipeline] { [Pipeline] checkout [2024-09-21T10:05:59.363Z] The recommended git tool is: git [2024-09-21T10:05:59.364Z] No credentials specified [2024-09-21T10:05:59.364Z] Cloning the remote Git repository [2024-09-21T10:05:59.364Z] Cloning repository https://github.com/dd010101/vyos-build.git [2024-09-21T10:05:59.364Z] > git init /var/lib/jenkins/workspace/linux-kernel_sagitta # timeout=10 [2024-09-21T10:05:59.368Z] Fetching upstream changes from https://github.com/dd010101/vyos-build.git [2024-09-21T10:05:59.368Z] > git --version # timeout=10 [2024-09-21T10:05:59.370Z] > git --version # 'git version 2.39.5' [2024-09-21T10:05:59.370Z] > git fetch --tags --force --progress -- https://github.com/dd010101/vyos-build.git +refs/heads/*:refs/remotes/origin/* # timeout=20 [2024-09-21T10:06:17.566Z] > git config remote.origin.url https://github.com/dd010101/vyos-build.git # timeout=10 [2024-09-21T10:06:17.568Z] > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 [2024-09-21T10:06:17.572Z] Avoid second fetch [2024-09-21T10:06:17.572Z] Checking out Revision 549e7920dba8e801b405169ab0d03da52f2285ff (sagitta) [2024-09-21T10:06:17.572Z] > git config core.sparsecheckout # timeout=10 [2024-09-21T10:06:17.574Z] > git checkout -f 549e7920dba8e801b405169ab0d03da52f2285ff # timeout=10 [2024-09-21T10:06:17.596Z] Commit message: "Merge branch 'vyos:sagitta' into sagitta" [Pipeline] withEnv [Pipeline] { [Pipeline] echo [2024-09-21T10:06:17.641Z] Warning, empty changelog. Have you run checkout? [Pipeline] script [Pipeline] { [Pipeline] sh [2024-09-21T10:06:17.937Z] + id -u [Pipeline] sh [2024-09-21T10:06:18.204Z] + id -g [Pipeline] } [Pipeline] // script [Pipeline] } [Pipeline] // withEnv [Pipeline] } [Pipeline] // node [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Build Code) [Pipeline] echo [2024-09-21T10:06:18.323Z] Warning, empty changelog. Have you run checkout? [Pipeline] parallel [Pipeline] { (Branch: amd64) [Pipeline] { (Branch: arm64) [Pipeline] stage [Pipeline] { (amd64) [Pipeline] stage [Pipeline] { (arm64) [Pipeline] getContext [Pipeline] node [2024-09-21T10:06:18.397Z] Running on Jenkins in /var/lib/jenkins/workspace/linux-kernel_sagitta Stage "arm64" skipped due to when conditional [Pipeline] getContext [Pipeline] } [Pipeline] { [Pipeline] // stage [Pipeline] } [Pipeline] checkout [2024-09-21T10:06:18.447Z] The recommended git tool is: git [2024-09-21T10:06:18.447Z] No credentials specified [2024-09-21T10:06:18.447Z] > git rev-parse --resolve-git-dir /var/lib/jenkins/workspace/linux-kernel_sagitta/.git # timeout=10 [2024-09-21T10:06:18.450Z] Fetching changes from the remote Git repository [2024-09-21T10:06:18.451Z] > git config remote.origin.url https://github.com/dd010101/vyos-build.git # timeout=10 [2024-09-21T10:06:18.455Z] Fetching upstream changes from https://github.com/dd010101/vyos-build.git [2024-09-21T10:06:18.455Z] > git --version # timeout=10 [2024-09-21T10:06:18.458Z] > git --version # 'git version 2.39.5' [2024-09-21T10:06:18.458Z] > git fetch --tags --force --progress -- https://github.com/dd010101/vyos-build.git +refs/heads/*:refs/remotes/origin/* # timeout=20 [2024-09-21T10:06:19.349Z] Checking out Revision 549e7920dba8e801b405169ab0d03da52f2285ff (sagitta) [2024-09-21T10:06:19.349Z] > git config core.sparsecheckout # timeout=10 [2024-09-21T10:06:19.353Z] > git checkout -f 549e7920dba8e801b405169ab0d03da52f2285ff # timeout=10 [2024-09-21T10:06:19.369Z] Commit message: "Merge branch 'vyos:sagitta' into sagitta" [Pipeline] withEnv [Pipeline] { [Pipeline] withEnv [Pipeline] { [Pipeline] withDockerRegistry [Pipeline] { [Pipeline] isUnix [Pipeline] withEnv [Pipeline] { [Pipeline] sh [2024-09-21T10:06:19.768Z] + docker pull 172.17.17.17:5000/vyos/vyos-build:sagitta [2024-09-21T10:06:19.768Z] sagitta: Pulling from vyos/vyos-build [2024-09-21T10:06:19.768Z] Digest: sha256:edfb415213731be308d42ab7e89a813e75a7dc61547b3d7173d5662bece9af56 [2024-09-21T10:06:19.768Z] Status: Image is up to date for 172.17.17.17:5000/vyos/vyos-build:sagitta [2024-09-21T10:06:19.768Z] 172.17.17.17:5000/vyos/vyos-build:sagitta [Pipeline] } [Pipeline] // withEnv [Pipeline] isUnix [Pipeline] withEnv [Pipeline] { [Pipeline] sh [2024-09-21T10:06:20.063Z] + docker inspect -f . vyos/vyos-build:sagitta [2024-09-21T10:06:20.063Z] . [Pipeline] } [Pipeline] // withEnv [Pipeline] withDockerContainer [2024-09-21T10:06:20.103Z] Jenkins does not seem to be running inside a container [2024-09-21T10:06:20.107Z] $ docker run -t -d -u 1006:1006 --sysctl net.ipv6.conf.lo.disable_ipv6=0 -e GOSU_UID=1006 -e GOSU_GID=1006 -w /var/lib/jenkins/workspace/linux-kernel_sagitta -v /var/lib/jenkins/workspace/linux-kernel_sagitta:/var/lib/jenkins/workspace/linux-kernel_sagitta:rw,z -v /var/lib/jenkins/workspace/linux-kernel_sagitta@tmp:/var/lib/jenkins/workspace/linux-kernel_sagitta@tmp:rw,z -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** vyos/vyos-build:sagitta cat [2024-09-21T10:06:20.300Z] $ docker top 79fe12cc5418552338caa96e5fc64adf723a70f75235a29c7a7806612b929e0d -eo pid,comm [2024-09-21T10:06:20.321Z] ERROR: The container started but didn't run the expected command. Please double check your ENTRYPOINT does execute the command passed as docker run argument, as required by official docker images (see https://github.com/docker-library/official-images#consistency for entrypoint consistency requirements). [2024-09-21T10:06:20.321Z] Alternatively you can force image entrypoint to be disabled by adding option `--entrypoint=''`. [Pipeline] { [Pipeline] script [Pipeline] { [Pipeline] dir [2024-09-21T10:06:20.359Z] Running in /var/lib/jenkins/workspace/linux-kernel_sagitta/build-amd64 [Pipeline] { [Pipeline] deleteDir [Pipeline] checkout [2024-09-21T10:06:20.383Z] The recommended git tool is: git [2024-09-21T10:06:20.383Z] No credentials specified [2024-09-21T10:06:20.383Z] Warning: JENKINS-30600: special launcher org.jenkinsci.plugins.docker.workflow.WithContainerStep$Decorator$1@2564763e; decorates hudson.Launcher$LocalLauncher@14d41f0a will be ignored (a typical symptom is the Git executable not being run inside a designated container) [2024-09-21T10:06:20.384Z] Cloning the remote Git repository [2024-09-21T10:06:20.384Z] Cloning repository https://github.com/dd010101/vyos-build.git [2024-09-21T10:06:20.384Z] > git init /var/lib/jenkins/workspace/linux-kernel_sagitta/build-amd64 # timeout=10 [2024-09-21T10:06:20.387Z] Fetching upstream changes from https://github.com/dd010101/vyos-build.git [2024-09-21T10:06:20.387Z] > git --version # timeout=10 [2024-09-21T10:06:20.389Z] > git --version # 'git version 2.39.5' [2024-09-21T10:06:20.389Z] > git fetch --tags --force --progress -- https://github.com/dd010101/vyos-build.git +refs/heads/*:refs/remotes/origin/* # timeout=20 [2024-09-21T10:06:40.044Z] > git config remote.origin.url https://github.com/dd010101/vyos-build.git # timeout=10 [2024-09-21T10:06:40.047Z] > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 [2024-09-21T10:06:40.050Z] Avoid second fetch [2024-09-21T10:06:40.050Z] Checking out Revision 549e7920dba8e801b405169ab0d03da52f2285ff (sagitta) [2024-09-21T10:06:40.051Z] > git config core.sparsecheckout # timeout=10 [2024-09-21T10:06:40.054Z] > git checkout -f 549e7920dba8e801b405169ab0d03da52f2285ff # timeout=10 [2024-09-21T10:06:40.075Z] Commit message: "Merge branch 'vyos:sagitta' into sagitta" [Pipeline] sh [2024-09-21T10:06:40.333Z] + git rev-parse --short=11 HEAD [Pipeline] dir [2024-09-21T10:06:40.358Z] Running in /var/lib/jenkins/workspace/linux-kernel_sagitta/build-amd64/packages/linux-kernel/linux-firmware [Pipeline] { [Pipeline] checkout [2024-09-21T10:06:40.372Z] The recommended git tool is: NONE [2024-09-21T10:06:40.372Z] No credentials specified [2024-09-21T10:06:40.372Z] Warning: JENKINS-30600: special launcher org.jenkinsci.plugins.docker.workflow.WithContainerStep$Decorator$1@38425030; decorates hudson.Launcher$LocalLauncher@72797a6d will be ignored (a typical symptom is the Git executable not being run inside a designated container) [2024-09-21T10:06:40.372Z] Cloning the remote Git repository [2024-09-21T10:06:40.372Z] Cloning repository https://mirrors.tuna.tsinghua.edu.cn/git/linux-firmware.git [2024-09-21T10:06:40.372Z] > git init /var/lib/jenkins/workspace/linux-kernel_sagitta/build-amd64/packages/linux-kernel/linux-firmware # timeout=10 [2024-09-21T10:06:40.376Z] Fetching upstream changes from https://mirrors.tuna.tsinghua.edu.cn/git/linux-firmware.git [2024-09-21T10:06:40.376Z] > git --version # timeout=10 [2024-09-21T10:06:40.378Z] > git --version # 'git version 2.39.5' [2024-09-21T10:06:40.378Z] > git fetch --tags --force --progress -- https://mirrors.tuna.tsinghua.edu.cn/git/linux-firmware.git +refs/heads/*:refs/remotes/origin/* # timeout=10 [2024-09-21T10:08:50.059Z] ERROR: Error cloning remote repo 'origin' [2024-09-21T10:08:50.059Z] hudson.plugins.git.GitException: Command "git fetch --tags --force --progress -- https://mirrors.tuna.tsinghua.edu.cn/git/linux-firmware.git +refs/heads/*:refs/remotes/origin/*" returned status code 128: [2024-09-21T10:08:50.059Z] stdout: [2024-09-21T10:08:50.059Z] stderr: remote: Enumerating objects: 21932 [2024-09-21T10:08:50.059Z] remote: Enumerating objects: 21932, done. [2024-09-21T10:08:50.059Z] Receiving objects: 0% (1/21932) [2024-09-21T10:08:50.059Z] Receiving objects: 1% (220/21932) [2024-09-21T10:08:50.059Z] Receiving objects: 2% (439/21932) [2024-09-21T10:08:50.059Z] Receiving objects: 3% (658/21932) [2024-09-21T10:08:50.059Z] Receiving objects: 4% (878/21932) [2024-09-21T10:08:50.059Z] Receiving objects: 5% (1097/21932) [2024-09-21T10:08:50.059Z] Receiving objects: 6% (1316/21932) [2024-09-21T10:08:50.059Z] Receiving objects: 7% (1536/21932), 892.00 KiB | 1.73 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 8% (1755/21932), 892.00 KiB | 1.73 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 9% (1974/21932), 892.00 KiB | 1.73 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 10% (2194/21932), 892.00 KiB | 1.73 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 11% (2413/21932), 892.00 KiB | 1.73 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 12% (2632/21932), 892.00 KiB | 1.73 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 13% (2852/21932), 892.00 KiB | 1.73 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 13% (2859/21932), 1.74 MiB | 1.67 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 14% (3071/21932), 1.74 MiB | 1.67 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 15% (3290/21932), 1.74 MiB | 1.67 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 16% (3510/21932), 1.74 MiB | 1.67 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 17% (3729/21932), 1.74 MiB | 1.67 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 18% (3948/21932), 1.74 MiB | 1.67 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 19% (4168/21932), 1.74 MiB | 1.67 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 20% (4387/21932), 1.74 MiB | 1.67 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 21% (4606/21932), 1.74 MiB | 1.67 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 22% (4826/21932), 1.74 MiB | 1.67 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 23% (5045/21932), 1.74 MiB | 1.67 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 24% (5264/21932), 2.58 MiB | 1.65 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 24% (5267/21932), 2.58 MiB | 1.65 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 24% (5340/21932), 4.27 MiB | 1.64 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 25% (5483/21932), 5.25 MiB | 1.68 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 25% (5634/21932), 6.12 MiB | 1.68 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 26% (5703/21932), 6.96 MiB | 1.67 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 26% (5716/21932), 7.88 MiB | 1.68 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 26% (5759/21932), 9.61 MiB | 1.70 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 26% (5878/21932), 11.34 MiB | 1.73 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 27% (5922/21932), 12.20 MiB | 1.73 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 27% (5999/21932), 13.15 MiB | 1.73 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 27% (6072/21932), 14.93 MiB | 1.75 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 27% (6084/21932), 16.70 MiB | 1.74 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 28% (6141/21932), 18.54 MiB | 1.74 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 28% (6266/21932), 18.54 MiB | 1.74 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 29% (6361/21932), 18.54 MiB | 1.74 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 29% (6463/21932), 20.93 MiB | 1.88 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 29% (6535/21932), 23.31 MiB | 1.99 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 29% (6568/21932), 25.55 MiB | 2.11 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 30% (6580/21932), 25.55 MiB | 2.11 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 30% (6634/21932), 27.98 MiB | 2.21 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 30% (6780/21932), 30.54 MiB | 2.33 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 31% (6799/21932), 30.54 MiB | 2.33 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 31% (6843/21932), 32.65 MiB | 2.26 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 31% (6951/21932), 33.50 MiB | 2.20 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 32% (7019/21932), 35.87 MiB | 2.22 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 32% (7021/21932), 35.87 MiB | 2.22 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 33% (7238/21932), 38.31 MiB | 2.23 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 33% (7263/21932), 38.31 MiB | 2.23 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 33% (7267/21932), 41.77 MiB | 2.17 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 33% (7343/21932), 42.90 MiB | 2.22 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 33% (7423/21932), 45.26 MiB | 2.26 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 34% (7457/21932), 45.26 MiB | 2.26 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 35% (7677/21932), 47.46 MiB | 2.23 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 35% (7683/21932), 47.46 MiB | 2.23 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 35% (7780/21932), 49.89 MiB | 2.24 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 35% (7818/21932), 52.29 MiB | 2.25 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 35% (7871/21932), 54.73 MiB | 2.29 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 36% (7896/21932), 57.13 MiB | 2.30 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 36% (7909/21932), 57.13 MiB | 2.30 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 36% (7949/21932), 59.64 MiB | 2.37 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 36% (8006/21932), 62.09 MiB | 2.37 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 36% (8042/21932), 64.56 MiB | 2.39 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 36% (8081/21932), 66.92 MiB | 2.35 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 36% (8096/21932), 69.36 MiB | 2.37 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 36% (8106/21932), 71.11 MiB | 2.23 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 37% (8115/21932), 72.31 MiB | 2.25 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 37% (8122/21932), 73.53 MiB | 2.25 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 37% (8126/21932), 75.89 MiB | 2.22 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 37% (8128/21932), 78.29 MiB | 2.21 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 37% (8160/21932), 80.64 MiB | 2.17 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 37% (8170/21932), 83.02 MiB | 2.30 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 37% (8171/21932), 85.34 MiB | 2.28 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 37% (8224/21932), 87.66 MiB | 2.26 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 37% (8244/21932), 88.86 MiB | 2.28 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 37% (8253/21932), 92.23 MiB | 2.25 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 37% (8254/21932), 94.60 MiB | 2.24 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 37% (8258/21932), 95.82 MiB | 2.26 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 37% (8264/21932), 99.43 MiB | 2.27 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 37% (8272/21932), 101.68 MiB | 2.29 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 37% (8274/21932), 102.79 MiB | 2.26 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 37% (8280/21932), 105.21 MiB | 2.28 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 37% (8280/21932), 107.58 MiB | 2.28 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 38% (8335/21932), 108.69 MiB | 2.24 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 38% (8357/21932), 108.69 MiB | 2.24 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 38% (8401/21932), 111.03 MiB | 2.26 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 38% (8417/21932), 113.40 MiB | 2.27 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 38% (8474/21932), 115.76 MiB | 2.24 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 38% (8488/21932), 118.16 MiB | 2.25 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 39% (8554/21932), 119.39 MiB | 2.29 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 40% (8773/21932), 120.57 MiB | 2.26 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 41% (8993/21932), 120.57 MiB | 2.26 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 41% (9059/21932), 120.57 MiB | 2.26 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 42% (9212/21932), 121.70 MiB | 2.27 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 42% (9234/21932), 122.92 MiB | 2.29 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 42% (9297/21932), 125.29 MiB | 2.30 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 42% (9310/21932), 127.71 MiB | 2.34 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 42% (9326/21932), 130.21 MiB | 2.33 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 42% (9341/21932), 132.07 MiB | 2.23 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 42% (9365/21932), 134.56 MiB | 2.25 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 42% (9378/21932), 137.05 MiB | 2.24 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 43% (9431/21932), 138.29 MiB | 2.27 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 43% (9448/21932), 138.29 MiB | 2.27 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 43% (9514/21932), 140.56 MiB | 2.21 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 43% (9540/21932), 142.93 MiB | 2.34 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 43% (9578/21932), 145.21 MiB | 2.28 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 44% (9651/21932), 146.39 MiB | 2.27 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 44% (9683/21932), 147.53 MiB | 2.24 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 44% (9696/21932), 149.83 MiB | 2.21 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 44% (9713/21932), 152.21 MiB | 2.19 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 44% (9726/21932), 154.63 MiB | 2.24 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 44% (9734/21932), 156.88 MiB | 2.22 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 44% (9746/21932), 158.87 MiB | 2.17 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 44% (9756/21932), 161.18 MiB | 2.18 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 44% (9772/21932), 163.46 MiB | 2.16 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 44% (9859/21932), 165.81 MiB | 2.19 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 44% (9860/21932), 167.04 MiB | 2.20 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 45% (9870/21932), 168.25 MiB | 2.29 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 45% (9885/21932), 170.64 MiB | 2.31 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 45% (9894/21932), 171.82 MiB | 2.28 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 45% (9906/21932), 174.17 MiB | 2.29 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 45% (9916/21932), 176.61 MiB | 2.30 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 45% (9928/21932), 179.07 MiB | 2.33 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 45% (9946/21932), 181.52 MiB | 2.34 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 45% (9960/21932), 183.94 MiB | 2.36 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 45% (9964/21932), 186.25 MiB | 2.33 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 45% (9970/21932), 188.58 MiB | 2.33 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 45% (9977/21932), 190.99 MiB | 2.28 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 45% (9981/21932), 193.33 MiB | 2.27 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 45% (9987/21932), 195.71 MiB | 2.25 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 45% (9997/21932), 198.03 MiB | 2.25 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 45% (10002/21932), 200.26 MiB | 2.24 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 45% (10009/21932), 202.71 MiB | 2.28 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 45% (10022/21932), 205.04 MiB | 2.25 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 45% (10029/21932), 205.62 MiB | 2.13 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 45% (10036/21932), 207.96 MiB | 2.12 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 45% (10047/21932), 210.36 MiB | 2.16 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 45% (10060/21932), 212.77 MiB | 2.13 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 45% (10070/21932), 215.08 MiB | 2.13 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 45% (10083/21932), 217.46 MiB | 2.26 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 46% (10089/21932), 217.46 MiB | 2.26 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 46% (10099/21932), 219.89 MiB | 2.31 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 46% (10106/21932), 222.29 MiB | 2.30 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 46% (10114/21932), 224.65 MiB | 2.31 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 46% (10121/21932), 227.06 MiB | 2.32 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 46% (10129/21932), 229.54 MiB | 2.34 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 46% (10135/21932), 232.02 MiB | 2.36 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 46% (10142/21932), 233.29 MiB | 2.39 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 46% (10153/21932), 236.91 MiB | 2.38 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 46% (10161/21932), 238.06 MiB | 2.38 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 46% (10173/21932), 240.55 MiB | 2.39 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 46% (10180/21932), 242.97 MiB | 2.39 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 46% (10192/21932), 245.37 MiB | 2.38 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 46% (10203/21932), 247.70 MiB | 2.33 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 46% (10217/21932), 250.10 MiB | 2.31 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 46% (10226/21932), 252.44 MiB | 2.27 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 46% (10245/21932), 254.85 MiB | 2.26 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 46% (10254/21932), 257.24 MiB | 2.30 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 46% (10264/21932), 259.67 MiB | 2.30 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 46% (10273/21932), 261.49 MiB | 2.19 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 46% (10281/21932), 263.93 MiB | 2.22 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 47% (10309/21932), 265.11 MiB | 2.22 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 47% (10405/21932), 266.31 MiB | 2.20 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 47% (10434/21932), 268.68 MiB | 2.20 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 47% (10476/21932), 269.80 MiB | 2.16 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 47% (10507/21932), 272.18 MiB | 2.27 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 47% (10526/21932), 274.63 MiB | 2.27 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 48% (10528/21932), 275.83 MiB | 2.28 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 48% (10550/21932), 277.11 MiB | 2.31 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 48% (10573/21932), 279.38 MiB | 2.29 MiB/s [2024-09-21T10:08:50.059Z] Receiving objects: 48% (10581/21932), 281.52 MiB | 2.24 MiB/s [2024-09-21T10:08:50.059Z] error: RPC failed; curl 56 GnuTLS recv error (-9): Error decoding the received TLS packet. [2024-09-21T10:08:50.059Z] error: 53026 bytes of body are still expected [2024-09-21T10:08:50.059Z] fetch-pack: unexpected disconnect while reading sideband packet [2024-09-21T10:08:50.059Z] fatal: early EOF [2024-09-21T10:08:50.059Z] fatal: fetch-pack: invalid index-pack output [2024-09-21T10:08:50.059Z] [2024-09-21T10:08:50.059Z] at PluginClassLoader for git-client//org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:2846) [2024-09-21T10:08:50.059Z] at PluginClassLoader for git-client//org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:2185) [2024-09-21T10:08:50.059Z] at PluginClassLoader for git-client//org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:635) [2024-09-21T10:08:50.059Z] at PluginClassLoader for git-client//org.jenkinsci.plugins.gitclient.CliGitAPIImpl$2.execute(CliGitAPIImpl.java:871) [2024-09-21T10:08:50.059Z] at PluginClassLoader for git//hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1220) [2024-09-21T10:08:50.059Z] at PluginClassLoader for git//hudson.plugins.git.GitSCM._checkout(GitSCM.java:1310) [2024-09-21T10:08:50.059Z] at PluginClassLoader for git//hudson.plugins.git.GitSCM.checkout(GitSCM.java:1277) [2024-09-21T10:08:50.059Z] at PluginClassLoader for workflow-scm-step//org.jenkinsci.plugins.workflow.steps.scm.SCMStep.checkout(SCMStep.java:136) [2024-09-21T10:08:50.059Z] at PluginClassLoader for workflow-scm-step//org.jenkinsci.plugins.workflow.steps.scm.SCMStep$StepExecutionImpl.run(SCMStep.java:101) [2024-09-21T10:08:50.059Z] at PluginClassLoader for workflow-scm-step//org.jenkinsci.plugins.workflow.steps.scm.SCMStep$StepExecutionImpl.run(SCMStep.java:88) [2024-09-21T10:08:50.059Z] at PluginClassLoader for workflow-step-api//org.jenkinsci.plugins.workflow.steps.SynchronousNonBlockingStepExecution.lambda$start$0(SynchronousNonBlockingStepExecution.java:47) [2024-09-21T10:08:50.059Z] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [2024-09-21T10:08:50.059Z] at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) [2024-09-21T10:08:50.059Z] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [2024-09-21T10:08:50.059Z] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [2024-09-21T10:08:50.059Z] at java.base/java.lang.Thread.run(Thread.java:840) [2024-09-21T10:08:50.059Z] ERROR: Error cloning remote repo 'origin' [2024-09-21T10:08:50.059Z] ERROR: Maximum checkout retry attempts reached, aborting [Pipeline] } [Pipeline] // dir [Pipeline] } [Pipeline] // dir [Pipeline] } [Pipeline] // script Post stage [Pipeline] deleteDir [Pipeline] } [2024-09-21T10:08:50.189Z] $ docker stop --time=1 79fe12cc5418552338caa96e5fc64adf723a70f75235a29c7a7806612b929e0d [2024-09-21T10:08:51.366Z] $ docker rm -f --volumes 79fe12cc5418552338caa96e5fc64adf723a70f75235a29c7a7806612b929e0d [Pipeline] // withDockerContainer [Pipeline] } [Pipeline] // withDockerRegistry [Pipeline] } [Pipeline] // withEnv [Pipeline] } [Pipeline] // withEnv [Pipeline] } [Pipeline] // node [Pipeline] } [Pipeline] // stage [Pipeline] } [2024-09-21T10:08:51.514Z] Failed in branch amd64 [Pipeline] // parallel [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Finalize) Stage "Finalize" skipped due to earlier failure(s) [Pipeline] getContext [Pipeline] } [Pipeline] // stage [Pipeline] } [Pipeline] // timestamps [Pipeline] } [Pipeline] // timeout [Pipeline] End of Pipeline ERROR: Error cloning remote repo 'origin' Finished: FAILURE ```

dd010101 commented 1 month ago

I'm not quite sure what to suggest since this is failure caused by outsides factors as unreliable connection to the servers or that servers drop the connection after while - there is nothing I can do about that and thus I can't give solution to such problems. I can only guess what could help as temporary workaround.

One workaround would be to use different protocol and not HTTPS. Perhaps plain GIT protocol will have more success? You can access the the firmware repository via GIT protocol with URL:

git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git

Another workaround could be local mirror. Can you mirror the repository locally? Perhaps you could manage to do mirror to local file system and then use the local repository somehow.

But first are you even able to do the clone locally?

git clone --mirror https://mirrors.tuna.tsinghua.edu.cn/git/linux-firmware.git

In the shell? If it doesn't work in the shell and there is no point to trying to build it with Jenkins.

MaurUppi commented 1 month ago

I'm not quite sure what to suggest since this is failure caused by outsides factors as unreliable connection to the servers or that servers drop the connection after while - there is nothing I can do about that and thus I can't give solution to such problems. I can only guess what could help as temporary workaround.

One workaround would be to use different protocol and not HTTPS. Perhaps plain GIT protocol will have more success? You can access the the firmware repository via GIT protocol with URL:

git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git

Another workaround could be local mirror. Can you mirror the repository locally? Perhaps you could mirror the local file system and then use the local repository somehow.

But first are you even able to do the clone locally?

git clone --mirror https://mirrors.tuna.tsinghua.edu.cn/git/linux-firmware.git

In the shell? If it doesn't work in the shell and there is no point to trying to build it with Jenkins.

Thanks for your support!

I'm new to Jenkins, so I'm not quite familiar with how to & where to change the script to use Git protocol but not HTTPS. I tried changing it in the replay script but failed due to the same issue.

What next should I do for the local mirror approach if I can git clone the repository from the Tsinghua mirror?


root@debian:/opt/vyos-jenkins# git clone --mirror https://mirrors.tuna.tsinghua.edu.cn/git/linux-firmware.git
Cloning into bare repository 'linux-firmware.git'...
remote: Enumerating objects: 22109, done.
remote: Total 22109 (delta 0), reused 0 (delta 0), pack-reused 22109
Receiving objects: 100% (22109/22109), 881.61 MiB | 1.46 MiB/s, done.
Resolving deltas: 100% (15318/15318), done.
dd010101 commented 1 month ago

Using local file system repository is bit tricky since the build is running inside Docker container and thus it doesn't have access to local file system.

I guess the easiest way would be to serve the local GIT repository over HTTP. You need webserver, if you followed the steps then you should have nginx, You need to setup nginx vhost, you can do it by forcing the 8th nginx step ./8-nginx.sh --force.

Then you can use the vhost directory to host your local GIT repository as well (this is normally used for the VyOS repository but it doesn't hurt if you add other files). Take the directory/repository you cloned (linux-firmware.git) and put it in /home/sentrium/web/dev.packages.vyos.net/public_html/repositories/. Now you should be able to access the repository via web browser at URL http://192.168.1.124/linux-firmware.git/.

To use the GIT repository you need to prepare the repository for "dumb server" use.

cd /home/sentrium/web/dev.packages.vyos.net/public_html/repositories/linux-firmware.git/
git --bare update-server-info

Now you should have the repository working via the local URL http://172.17.17.17/linux-firmware.git/ as replacement for https://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git.

You can test it in local shell by git clone http://172.17.17.17/linux-firmware.git/.

The only easy way to change the GIT repository URL is the way you found yourself - the Replay. Thus use the Replay the way you did just use your own URL and this should in theory work.

I don't know Jenkins much either so I'm just guessing...

MaurUppi commented 1 month ago

Wow，，，the Linux-firmware.git part looks passed. 

00:09:57  Running in /var/lib/jenkins/workspace/linux-kernel_sagitta/build-amd64/packages/linux-kernel/linux-firmware
[Pipeline] {
[Pipeline] checkout
00:09:57  The recommended git tool is: NONE
00:09:57  No credentials specified
00:09:57  Warning: JENKINS-30600: special launcher org.jenkinsci.plugins.docker.workflow.WithContainerStep$Decorator$1@10384033; decorates hudson.Launcher$LocalLauncher@327229b8 will be ignored (a typical symptom is the Git executable not being run inside a designated container)
00:09:57  Cloning the remote Git repository
00:09:57  Cloning repository http://172.17.17.17/linux-firmware.git/
00:09:57   > git init /var/lib/jenkins/workspace/linux-kernel_sagitta/build-amd64/packages/linux-kernel/linux-firmware # timeout=10
00:09:57  Fetching upstream changes from http://172.17.17.17/linux-firmware.git/
00:09:57   > git --version # timeout=10
00:09:57   > git --version # 'git version 2.39.5'
00:09:57   > git fetch --tags --force --progress -- http://172.17.17.17/linux-firmware.git/ +refs/heads/*:refs/remotes/origin/* # timeout=10
00:10:19   > git config remote.origin.url http://172.17.17.17/linux-firmware.git/ # timeout=10
00:10:19   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
00:10:19  Avoid second fetch
00:10:19   > git rev-parse 20231211^{commit} # timeout=10
00:10:19  Checking out Revision f2e52a1c5861fde69aee517ffaf798b630bdf36b (detached)
00:10:19   > git config core.sparsecheckout # timeout=10
00:10:19   > git checkout -f f2e52a1c5861fde69aee517ffaf798b630bdf36b # timeout=10
00:10:24  Commit message: "Merge branch 'wfx' into 'main'"
00:10:24  First time build. Skipping changelog.
00:10:24  Cleaning workspace
00:10:24   > git rev-parse --verify HEAD # timeout=10
00:10:24  Resetting working tree
00:10:24   > git reset --hard # timeout=10
00:10:24   > git clean -fdx # timeout=10

But a new issue has come out. What is your recommendation? 

00:10:30  Running in /var/lib/jenkins/workspace/linux-kernel_sagitta/build-amd64/packages/linux-kernel/kernel
[Pipeline] {
[Pipeline] sh
00:10:30  + cd ..
00:10:30  + cat ../../data/defaults.toml
00:10:30  + tomlq -r .kernel_version
00:10:30  + KERNEL_VER=6.6.49
00:10:30  + gpg2 --locate-keys torvalds@kernel.org gregkh@kernel.org
00:10:30  gpg: directory '/home/vyos_bld/.gnupg' created
00:10:30  gpg: keybox '/home/vyos_bld/.gnupg/pubring.kbx' created
00:10:30  gpg: /home/vyos_bld/.gnupg/trustdb.gpg: trustdb created
00:10:31  gpg: error retrieving 'gregkh@kernel.org' via WKD: Network error
00:10:31  gpg: error reading key: Network error
00:10:31  gpg: error retrieving 'torvalds@kernel.org' via WKD: Network error
00:10:31  gpg: error reading key: Network error

I tried to ask ChatGPT, and they told me one of the options is to import it manually. However, gregkh & torvalds's pubkey.asc is NOT there. 

wget https://kernel.org/pub/linux/kernel/people/torvalds/pubkey.asc
gpg --import pubkey.asc
root@debian:/opt/vyos-jenkins# wget https://kernel.org/pub/linux/kernel/people/torvalds/pubkey.asc
--2024-09-22 00:17:32--  https://kernel.org/pub/linux/kernel/people/torvalds/pubkey.asc
Resolving kernel.org (kernel.org)... 198.19.13.229
Connecting to kernel.org (kernel.org)|198.19.13.229|:443... connected.
HTTP request sent, awaiting response... 301 Moved Permanently
Location: https://mirrors.edge.kernel.org/pub/linux/kernel/people/torvalds/pubkey.asc [following]
--2024-09-22 00:17:33--  https://mirrors.edge.kernel.org/pub/linux/kernel/people/torvalds/pubkey.asc
Resolving mirrors.edge.kernel.org (mirrors.edge.kernel.org)... 198.19.13.230
Connecting to mirrors.edge.kernel.org (mirrors.edge.kernel.org)|198.19.13.230|:443... connected.
HTTP request sent, awaiting response... 404 Not Found
2024-09-22 00:17:34 ERROR 404: Not Found.
dd010101 commented 1 month ago

Many network issues...

The successful gpg search looks like this:

# gpg --locate-keys torvalds@kernel.org gregkh@kernel.org
gpg: key 38DBBDC86092693E: public key "Greg Kroah-Hartman <gregkh@kernel.org>" imported
gpg: Total number processed: 1
gpg:               imported: 1
gpg: key 79BE3E4300411886: public key "Linus Torvalds <torvalds@kernel.org>" imported
gpg: Total number processed: 1
gpg:               imported: 1
pub   rsa4096 2011-09-23 [SC]
      647F28654894E3BD457199BE38DBBDC86092693E
uid           [ unknown] Greg Kroah-Hartman <gregkh@kernel.org>
sub   rsa4096 2011-09-23 [E]

pub   rsa2048 2011-09-20 [SC]
      ABAF11C65A2970B130ABE3C479BE3E4300411886
uid           [ unknown] Linus Torvalds <torvalds@kernel.org>
sub   rsa2048 2011-09-20 [E]

You can find both keys at https://pgp.surf.nl/ by their key ID: https://pgp.surf.nl/pks/lookup?op=get&search=0x647f28654894e3bd457199be38dbbdc86092693e https://pgp.surf.nl/pks/lookup?op=get&search=0xabaf11c65a2970b130abe3c479be3e4300411886

But now the same issue arises - the build is execute withing Docker container thus if you import these keys locally you archive nothing.

Use the Replay again and add another modification:

Well if the https://pgp.surf.nl/ works for you... You can also find these keys by their key ID somewhere... Put them in the same location as linux-firmware.git and use the same trick with local web server wget http://172.17.17.17/gregkh.asc...

MaurUppi commented 1 month ago

Hi dd

So lovely and quick response you are!!

Here is the full replay script. You may notice that it uses gpg2, which is not on my Debian system.

I tried to change it with your replace code. Finally!!!! It works and compiles started. 

01:02:28    CC      kernel/locking/rtmutex_api.o
01:02:28    CC      arch/x86/kernel/fpu/regset.o
01:02:28    CC      arch/x86/mm/init_64.o
01:02:28    CC      arch/x86/kernel/fpu/signal.o
01:02:28    CC      arch/x86/mm/pat/memtype.o
01:02:28    CC      kernel/locking/qrwlock.o
01:02:28    CC      arch/x86/kernel/fpu/xstate.o
01:02:29    AR      kernel/locking/built-in.a
01:02:29    CC      kernel/power/qos.o
01:02:29    CC      arch/x86/mm/pat/memtype_interval.o
01:02:29    CC      kernel/power/main.o
01:02:30    AR      arch/x86/mm/pat/built-in.a
01:02:30    CC      arch/x86/mm/fault.o
01:02:30    AR      arch/x86/kernel/fpu/built-in.a
01:02:30    CC      arch/x86/kernel/cpu/mce/core.o
01:02:30    CC      arch/x86/kernel/cpu/mtrr/mtrr.o
01:02:30    CC      arch/x86/mm/ioremap.o
01:02:30    CC      kernel/power/console.o
01:02:31    CC      arch/x86/kernel/cpu/mtrr/if.o
01:02:31    CC      arch/x86/kernel/cpu/mtrr/generic.o
01:02:31    CC      kernel/power/process.o
01:02:31    CC      arch/x86/kernel/cpu/mce/severity.o
01:02:31    CC      arch/x86/mm/extable.o
// Copyright (C) 2020-2024 VyOS maintainers and contributors
//
// This program is free software; you can redistribute it and/or modify
// in order to easy exprort images built to "external" world
// it under the terms of the GNU General Public License version 2 or later as
// published by the Free Software Foundation.
//
// This program is distributed in the hope that it will be useful,
// but WITHOUT ANY WARRANTY; without even the implied warranty of
// MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
// GNU General Public License for more details.
//
// You should have received a copy of the GNU General Public License
// along with this program.  If not, see <http://www.gnu.org/licenses/>.
@NonCPS

// Using a version specifier library, use 'sagitta' branch. The underscore (_)
// is not a typo! You need this underscore if the line immediately after the
// @Library annotation is not an import statement!
@Library('vyos-build@sagitta')_

def pkgList = [
    // The Linux Kernel
    ['name': 'kernel',
     'buildCmd': '''
        # all scripts must be executed one level above ...
        cd ..

        # read the required Kernel version
        KERNEL_VER=\$(cat ../../data/defaults.toml | tomlq -r .kernel_version)
        gpg2 --locate-keys torvalds@kernel.org gregkh@kernel.org
        curl -OL https://www.kernel.org/pub/linux/kernel/v6.x/linux-${KERNEL_VER}.tar.xz
        curl -OL https://www.kernel.org/pub/linux/kernel/v6.x/linux-${KERNEL_VER}.tar.sign
        xz -cd linux-${KERNEL_VER}.tar.xz | gpg2 --verify linux-${KERNEL_VER}.tar.sign -
        if [ $? -ne 0 ]; then
            exit 1
        fi

        # Unpack Kernel source
        tar xf linux-${KERNEL_VER}.tar.xz
        ln -s linux-${KERNEL_VER} linux
        # ... Build Kernel
        ./build-kernel.sh
     '''],

    // Firmware
    ['name': 'linux-firmware', 'scmCommit': '20231211',
     'scmUrl': 'http://172.17.17.17/linux-firmware.git/',
     'buildCmd': 'cd ..; ./build-linux-firmware.sh'],

    // Accel-PPP
    ['name': 'accel-ppp', 'scmCommit': '19c36e593d9b',
     'scmUrl': 'https://github.com/accel-ppp/accel-ppp.git',
     'buildCmd': 'cd ..; pwd; ls -al; ./build-accel-ppp.sh'],

    // Intel QAT
    ['name': 'qat', 'buildCmd': 'cd ..; ./build-intel-qat.sh'],

    // Intel IXGBE
    ['name': 'ixgbe', 'buildCmd': 'cd ..; ./build-intel-ixgbe.sh'],

    // Intel IXGBEVF
    ['name': 'ixgbevf', 'buildCmd': 'cd ..; ./build-intel-ixgbevf.sh'],

    // Jool
    ['name': 'jool', 'buildCmd': 'cd ..; ./build-jool.py'],

    // OpenVPN DCO
    ['name': 'ovpn-dco','scmCommit': 'v0.2.20231117',
     'scmUrl': 'https://github.com/OpenVPN/ovpn-dco',
     'buildCmd': 'cd ..; ./build-openvpn-dco.sh'],
]

// Start package build using library function from https://github.com/vyos/vyos-build
buildPackage('Kernel', pkgList, null, true, "(.*packages/linux-kernel/.+|.*data/defaults.+)", "ec2_amd64", "REGEXP")
MaurUppi commented 1 month ago

A new issue comes one more time, sigh....

image

I'm considering commenting out build-intel-ixgbe.sh parts because I don't have Intel Ethernet 500 Series Linux driver (ixgbe) and the MB not have it also.

[2024-09-21T17:58:21.062Z] curl: (35) OpenSSL SSL_connect: SSL_ERROR_SYSCALL in connection to cyfuture.dl.sourceforge.net:443

Test and found I can't even ping cyfuture.dl.sourceforge.net

Details

``` root@debian:/opt/vyos-jenkins# dig cyfuture.dl.sourceforge.net @120.53.53.201 ; <<>> DiG 9.18.28-1~deb12u2-Debian <<>> cyfuture.dl.sourceforge.net @120.53.53.201 ;; global options: +cmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 35797 ;; flags: qr rd ra; QUERY: 1, ANSWER: 1, AUTHORITY: 0, ADDITIONAL: 1 ;; OPT PSEUDOSECTION: ; EDNS: version: 0, flags:; udp: 1232 ; COOKIE: c1ad7feb4a60899d (echoed) ;; QUESTION SECTION: ;cyfuture.dl.sourceforge.net. IN A ;; ANSWER SECTION: cyfuture.dl.sourceforge.net. 255 IN A 49.50.119.27 ;; Query time: 16 msec ;; SERVER: 120.53.53.201#53(120.53.53.201) (UDP) ;; WHEN: Sun Sep 22 02:09:02 HKT 2024 ;; MSG SIZE rcvd: 84 root@debian:/opt/vyos-jenkins# ping 49.50.119.27 PING 49.50.119.27 (49.50.119.27) 56(84) bytes of data. ^C --- 49.50.119.27 ping statistics --- 53 packets transmitted, 0 received, 100% packet loss, time 53231ms ```

It's odd. So, I open the build-intel-ixgeb.sh to check it out. Here is the link url="https://sourceforge.net/projects/e1000/files/ixgbe%20stable/5.20.3/ixgbe-5.20.3.tar.gz" So, I opened it and found the message below. What the heck!!!

Notice! Effective August 16, 2024, Intel will no longer use Sourceforge to distribute software for Ethernet products.
====================
Please refer to our GitHub location for future software updates here:
https://intel.github.io/ethernet-linux/
Details

``` [2024-09-21T17:56:05.357Z] + cd .. [2024-09-21T17:56:05.357Z] + ./build-intel-ixgbe.sh [2024-09-21T17:56:05.357Z] % Total % Received % Xferd Average Speed Time Time Time Current [2024-09-21T17:56:05.357Z] Dload Upload Total Spent Left Speed [2024-09-21T17:56:05.357Z] [2024-09-21T17:56:05.607Z] 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 [2024-09-21T17:56:05.607Z] 100 374 0 374 0 0 1035 0 --:--:-- --:--:-- --:--:-- 1036 [2024-09-21T17:56:05.858Z] [2024-09-21T17:56:05.858Z] 100 390 0 390 0 0 601 0 --:--:-- --:--:-- --:--:-- 601 [2024-09-21T17:56:05.858Z] 100 390 0 390 0 0 601 0 --:--:-- --:--:-- --:--:-- 0 [2024-09-21T17:56:06.108Z] [2024-09-21T17:56:06.108Z] 100 627 0 627 0 0 696 0 --:--:-- --:--:-- --:--:-- 696 [2024-09-21T17:56:06.659Z] [2024-09-21T17:56:06.659Z] 100 381 100 381 0 0 260 0 0:00:01 0:00:01 --:--:-- 260 [2024-09-21T17:56:06.909Z] [2024-09-21T17:56:08.252Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0 [2024-09-21T17:56:09.163Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:02 --:--:-- 0 [2024-09-21T17:56:10.073Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:03 --:--:-- 0 [2024-09-21T17:56:10.984Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:04 --:--:-- 0 [2024-09-21T17:56:11.895Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:05 --:--:-- 0 [2024-09-21T17:56:13.238Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:06 --:--:-- 0 [2024-09-21T17:56:14.149Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:07 --:--:-- 0 [2024-09-21T17:56:15.060Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:08 --:--:-- 0 [2024-09-21T17:56:15.970Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:09 --:--:-- 0 [2024-09-21T17:56:16.881Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:10 --:--:-- 0 [2024-09-21T17:56:18.224Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:11 --:--:-- 0 [2024-09-21T17:56:19.135Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:12 --:--:-- 0 [2024-09-21T17:56:20.046Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:13 --:--:-- 0 [2024-09-21T17:56:20.957Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:14 --:--:-- 0 [2024-09-21T17:56:22.300Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:15 --:--:-- 0 [2024-09-21T17:56:23.211Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:16 --:--:-- 0 [2024-09-21T17:56:24.121Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:17 --:--:-- 0 [2024-09-21T17:56:25.032Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:18 --:--:-- 0 [2024-09-21T17:56:25.943Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:19 --:--:-- 0 [2024-09-21T17:56:27.286Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:20 --:--:-- 0 [2024-09-21T17:56:28.197Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:21 --:--:-- 0 [2024-09-21T17:56:29.108Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:22 --:--:-- 0 [2024-09-21T17:56:30.018Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:23 --:--:-- 0 [2024-09-21T17:56:30.929Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:24 --:--:-- 0 [2024-09-21T17:56:32.272Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:25 --:--:-- 0 [2024-09-21T17:56:33.183Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:26 --:--:-- 0 [2024-09-21T17:56:34.094Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:27 --:--:-- 0 [2024-09-21T17:56:35.005Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:28 --:--:-- 0 [2024-09-21T17:56:35.916Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:29 --:--:-- 0 [2024-09-21T17:56:37.259Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:30 --:--:-- 0 [2024-09-21T17:56:38.170Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:31 --:--:-- 0 [2024-09-21T17:56:39.080Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:32 --:--:-- 0 [2024-09-21T17:56:39.991Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:33 --:--:-- 0 [2024-09-21T17:56:40.902Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:34 --:--:-- 0 [2024-09-21T17:56:42.245Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:35 --:--:-- 0 [2024-09-21T17:56:43.156Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:36 --:--:-- 0 [2024-09-21T17:56:44.067Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:37 --:--:-- 0 [2024-09-21T17:56:44.978Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:38 --:--:-- 0 [2024-09-21T17:56:46.321Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:39 --:--:-- 0 [2024-09-21T17:56:47.232Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:40 --:--:-- 0 [2024-09-21T17:56:48.142Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:41 --:--:-- 0 [2024-09-21T17:56:49.053Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:42 --:--:-- 0 [2024-09-21T17:56:49.964Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:43 --:--:-- 0 [2024-09-21T17:56:51.307Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:44 --:--:-- 0 [2024-09-21T17:56:52.218Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:45 --:--:-- 0 [2024-09-21T17:56:53.129Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:46 --:--:-- 0 [2024-09-21T17:56:54.040Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:47 --:--:-- 0 [2024-09-21T17:56:54.951Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:48 --:--:-- 0 [2024-09-21T17:56:56.294Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:49 --:--:-- 0 [2024-09-21T17:56:57.205Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:50 --:--:-- 0 [2024-09-21T17:56:58.115Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:51 --:--:-- 0 [2024-09-21T17:56:59.026Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:52 --:--:-- 0 [2024-09-21T17:56:59.937Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:53 --:--:-- 0 [2024-09-21T17:57:01.280Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:54 --:--:-- 0 [2024-09-21T17:57:02.191Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:55 --:--:-- 0 [2024-09-21T17:57:03.102Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:56 --:--:-- 0 [2024-09-21T17:57:04.013Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:57 --:--:-- 0 [2024-09-21T17:57:05.356Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:58 --:--:-- 0 [2024-09-21T17:57:06.267Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:59 --:--:-- 0 [2024-09-21T17:57:07.178Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:00 --:--:-- 0 [2024-09-21T17:57:08.089Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:01 --:--:-- 0 [2024-09-21T17:57:08.999Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:02 --:--:-- 0 [2024-09-21T17:57:10.342Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:03 --:--:-- 0 [2024-09-21T17:57:11.253Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:04 --:--:-- 0 [2024-09-21T17:57:12.164Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:05 --:--:-- 0 [2024-09-21T17:57:13.075Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:06 --:--:-- 0 [2024-09-21T17:57:13.986Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:07 --:--:-- 0 [2024-09-21T17:57:15.328Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:08 --:--:-- 0 [2024-09-21T17:57:16.239Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:09 --:--:-- 0 [2024-09-21T17:57:17.150Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:10 --:--:-- 0 [2024-09-21T17:57:18.061Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:11 --:--:-- 0 [2024-09-21T17:57:18.972Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:12 --:--:-- 0 [2024-09-21T17:57:20.315Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:13 --:--:-- 0 [2024-09-21T17:57:21.226Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:14 --:--:-- 0 [2024-09-21T17:57:22.136Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:15 --:--:-- 0 [2024-09-21T17:57:23.047Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:16 --:--:-- 0 [2024-09-21T17:57:23.958Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:17 --:--:-- 0 [2024-09-21T17:57:25.301Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:18 --:--:-- 0 [2024-09-21T17:57:26.212Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:19 --:--:-- 0 [2024-09-21T17:57:27.123Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:20 --:--:-- 0 [2024-09-21T17:57:28.034Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:21 --:--:-- 0 [2024-09-21T17:57:29.377Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:22 --:--:-- 0 [2024-09-21T17:57:30.287Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:23 --:--:-- 0 [2024-09-21T17:57:31.198Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:24 --:--:-- 0 [2024-09-21T17:57:32.109Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:25 --:--:-- 0 [2024-09-21T17:57:33.020Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:26 --:--:-- 0 [2024-09-21T17:57:34.363Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:27 --:--:-- 0 [2024-09-21T17:57:35.274Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:28 --:--:-- 0 [2024-09-21T17:57:36.184Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:29 --:--:-- 0 [2024-09-21T17:57:37.095Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:30 --:--:-- 0 [2024-09-21T17:57:38.006Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:31 --:--:-- 0 [2024-09-21T17:57:39.349Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:32 --:--:-- 0 [2024-09-21T17:57:40.260Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:33 --:--:-- 0 [2024-09-21T17:57:41.171Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:34 --:--:-- 0 [2024-09-21T17:57:42.082Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:35 --:--:-- 0 [2024-09-21T17:57:42.993Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:36 --:--:-- 0 [2024-09-21T17:57:44.336Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:37 --:--:-- 0 [2024-09-21T17:57:45.247Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:38 --:--:-- 0 [2024-09-21T17:57:46.157Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:39 --:--:-- 0 [2024-09-21T17:57:47.068Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:40 --:--:-- 0 [2024-09-21T17:57:48.411Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:41 --:--:-- 0 [2024-09-21T17:57:49.322Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:42 --:--:-- 0 [2024-09-21T17:57:50.233Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:43 --:--:-- 0 [2024-09-21T17:57:51.144Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:44 --:--:-- 0 [2024-09-21T17:57:52.055Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:45 --:--:-- 0 [2024-09-21T17:57:53.398Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:46 --:--:-- 0 [2024-09-21T17:57:54.309Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:47 --:--:-- 0 [2024-09-21T17:57:55.220Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:48 --:--:-- 0 [2024-09-21T17:57:56.130Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:49 --:--:-- 0 [2024-09-21T17:57:57.041Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:50 --:--:-- 0 [2024-09-21T17:57:58.384Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:51 --:--:-- 0 [2024-09-21T17:57:59.295Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:52 --:--:-- 0 [2024-09-21T17:58:00.206Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:53 --:--:-- 0 [2024-09-21T17:58:01.117Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:54 --:--:-- 0 [2024-09-21T17:58:02.028Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:55 --:--:-- 0 [2024-09-21T17:58:03.371Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:56 --:--:-- 0 [2024-09-21T17:58:04.282Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:57 --:--:-- 0 [2024-09-21T17:58:05.192Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:58 --:--:-- 0 [2024-09-21T17:58:06.103Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:59 --:--:-- 0 [2024-09-21T17:58:07.014Z] 0 0 0 0 0 0 0 0 --:--:-- 0:02:00 --:--:-- 0 [2024-09-21T17:58:08.357Z] 0 0 0 0 0 0 0 0 --:--:-- 0:02:01 --:--:-- 0 [2024-09-21T17:58:09.268Z] 0 0 0 0 0 0 0 0 --:--:-- 0:02:02 --:--:-- 0 [2024-09-21T17:58:10.179Z] 0 0 0 0 0 0 0 0 --:--:-- 0:02:03 --:--:-- 0 [2024-09-21T17:58:11.089Z] 0 0 0 0 0 0 0 0 --:--:-- 0:02:04 --:--:-- 0 [2024-09-21T17:58:12.432Z] 0 0 0 0 0 0 0 0 --:--:-- 0:02:05 --:--:-- 0 [2024-09-21T17:58:13.343Z] 0 0 0 0 0 0 0 0 --:--:-- 0:02:06 --:--:-- 0 [2024-09-21T17:58:14.254Z] 0 0 0 0 0 0 0 0 --:--:-- 0:02:07 --:--:-- 0 [2024-09-21T17:58:15.164Z] 0 0 0 0 0 0 0 0 --:--:-- 0:02:08 --:--:-- 0 [2024-09-21T17:58:16.075Z] 0 0 0 0 0 0 0 0 --:--:-- 0:02:09 --:--:-- 0 [2024-09-21T17:58:17.418Z] 0 0 0 0 0 0 0 0 --:--:-- 0:02:10 --:--:-- 0 [2024-09-21T17:58:18.329Z] 0 0 0 0 0 0 0 0 --:--:-- 0:02:11 --:--:-- 0 [2024-09-21T17:58:19.240Z] 0 0 0 0 0 0 0 0 --:--:-- 0:02:12 --:--:-- 0 [2024-09-21T17:58:20.151Z] 0 0 0 0 0 0 0 0 --:--:-- 0:02:13 --:--:-- 0 [2024-09-21T17:58:21.062Z] 0 0 0 0 0 0 0 0 --:--:-- 0:02:14 --:--:-- 0 [2024-09-21T17:58:21.062Z] 0 0 0 0 0 0 0 0 --:--:-- 0:02:15 --:--:-- 0 [2024-09-21T17:58:21.062Z] curl: (35) OpenSSL SSL_connect: SSL_ERROR_SYSCALL in connection to cyfuture.dl.sourceforge.net:443 ```

dd010101 commented 1 month ago

The SourceForge link works fine for me... Looks like your network has some serious shortcomings! 🤔

What about?

cd /home/sentrium/web/dev.packages.vyos.net/public_html/repositories/
wget https://downloadmirror.intel.com/822710/ixgbe-5.20.3.tar.gz

Then another Replay modification from:

cd ..; ./build-intel-ixgbe.sh

To

cd ..; sed -i \'s~^url=".*~url="http://172.17.17.17/ixgbe-5.20.3.tar.gz"~\' build-intel-ixgbe.sh; ./build-intel-ixgbe.sh
MaurUppi commented 1 month ago

For the full project name: linux-kernel/sagitta, its done success finally.

I commented out below two parts given I don't have to use it. Intel Ethernet 500 Series Linux driver (ixgbe) & Intel Ethernet 500 Series Virtual Function Linux driver (ixgbevf) - for use with the ixgbe PF driver.

    // Intel IXGBE
    // ['name': 'ixgbe', 'buildCmd': 'cd ..; ./build-intel-ixgbe.sh'],

    // Intel IXGBEVF
    // ['name': 'ixgbevf', 'buildCmd': 'cd ..; ./build-intel-ixgbevf.sh'],

image

Help needed for linux-kernel/equuleus

image

[2024-09-21T18:59:41.527Z] The recommended git tool is: NONE
[2024-09-21T18:59:41.527Z] Warning: CredentialId "GitHub-vyosbot" could not be found.
[2024-09-21T18:59:41.527Z] Warning: JENKINS-30600: special launcher org.jenkinsci.plugins.docker.workflow.WithContainerStep$Decorator$1@25d1698b; decorates hudson.Launcher$LocalLauncher@e2062f9 will be ignored (a typical symptom is the Git executable not being run inside a designated container)
[2024-09-21T18:59:41.527Z] Cloning the remote Git repository
[2024-09-21T18:59:41.527Z] Using shallow clone with depth 1
[2024-09-21T18:59:41.527Z] Cloning repository http://172.17.17.17/linux-firmware.git
[2024-09-21T18:59:41.527Z]  > git init /var/lib/jenkins/workspace/linux-kernel_equuleus/packages/linux-kernel/linux-firmware # timeout=10
[2024-09-21T18:59:41.532Z] Fetching upstream changes from http://172.17.17.17/linux-firmware.git
[2024-09-21T18:59:41.532Z]  > git --version # timeout=10
[2024-09-21T18:59:41.534Z]  > git --version # 'git version 2.39.5'
[2024-09-21T18:59:41.534Z]  > git fetch --tags --force --progress --depth=1 -- http://172.17.17.17/linux-firmware.git +refs/heads/*:refs/remotes/origin/* # timeout=10
[2024-09-21T18:59:41.544Z] ERROR: Error cloning remote repo 'origin'
[2024-09-21T18:59:41.544Z] hudson.plugins.git.GitException: Command "git fetch --tags --force --progress --depth=1 -- http://172.17.17.17/linux-firmware.git +refs/heads/*:refs/remotes/origin/*" returned status code 128:
[2024-09-21T18:59:41.544Z] stdout: 
[2024-09-21T18:59:41.544Z] stderr: fatal: dumb http transport does not support shallow capabilities
[2024-09-21T18:59:41.544Z] 
[2024-09-21T18:59:41.545Z]  at PluginClassLoader for git-client//org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:2846)
[2024-09-21T18:59:41.545Z]  at PluginClassLoader for git-client//org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:2185)
[2024-09-21T18:59:41.545Z]  at PluginClassLoader for git-client//org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:635)
[2024-09-21T18:59:41.545Z]  at PluginClassLoader for git-client//org.jenkinsci.plugins.gitclient.CliGitAPIImpl$2.execute(CliGitAPIImpl.java:871)
[2024-09-21T18:59:41.545Z]  at PluginClassLoader for git//hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1220)
[2024-09-21T18:59:41.545Z]  at PluginClassLoader for git//hudson.plugins.git.GitSCM._checkout(GitSCM.java:1310)
[2024-09-21T18:59:41.545Z]  at PluginClassLoader for git//hudson.plugins.git.GitSCM.checkout(GitSCM.java:1277)
[2024-09-21T18:59:41.545Z]  at PluginClassLoader for workflow-scm-step//org.jenkinsci.plugins.workflow.steps.scm.SCMStep.checkout(SCMStep.java:136)
[2024-09-21T18:59:41.545Z]  at PluginClassLoader for workflow-scm-step//org.jenkinsci.plugins.workflow.steps.scm.SCMStep$StepExecutionImpl.run(SCMStep.java:101)
[2024-09-21T18:59:41.545Z]  at PluginClassLoader for workflow-scm-step//org.jenkinsci.plugins.workflow.steps.scm.SCMStep$StepExecutionImpl.run(SCMStep.java:88)
[2024-09-21T18:59:41.545Z]  at PluginClassLoader for workflow-step-api//org.jenkinsci.plugins.workflow.steps.SynchronousNonBlockingStepExecution.lambda$start$0(SynchronousNonBlockingStepExecution.java:47)
[2024-09-21T18:59:41.545Z]  at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
[2024-09-21T18:59:41.545Z]  at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[2024-09-21T18:59:41.545Z]  at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
[2024-09-21T18:59:41.545Z]  at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
[2024-09-21T18:59:41.545Z]  at java.base/java.lang.Thread.run(Thread.java:840)
[2024-09-21T18:59:41.545Z] ERROR: Error cloning remote repo 'origin'
[2024-09-21T18:59:41.545Z] ERROR: Maximum checkout retry attempts reached, aborting
dd010101 commented 1 month ago

~Didn't you enable shallow clone in the Jenkins Pipeline/Job settings? Make sure it's off.~

EDIT: Sorry, I see it's hardcoded here, you can edit this in the Replay and remove the depth:1 and shallow:true. Thus the settings in Jenkins don't have effect they are overriden in the Jenkinsfile.

https://github.com/vyos/vyos-build/blob/equuleus/packages/linux-kernel/Jenkinsfile#L122

The depth/shallow is irrelevant here, it just saves bandwidth and time, it doesn't change the result.

The simple local web GIT repository can't do shallow clone that's why it's failing - you would need more sophisticated git-daemon to make local HTTP GIT repository with all features.

MaurUppi commented 1 month ago

~Didn't you enable shallow clone in the Jenkins Pipeline/Job settings? Make sure it's off.~

EDIT: Sorry, I see it's hardcoded here, you can edit this in the Replay and remove the depth:1 and shallow:true. Thus the settings in Jenkins don't have effect they are overriden in the Jenkinsfile.

https://github.com/vyos/vyos-build/blob/equuleus/packages/linux-kernel/Jenkinsfile#L122

The depth/shallow is irrelevant here, it just saves bandwidth and time, it doesn't change the result.

The simple local web GIT repository can't do shallow clone that's why it's failing - you would need more sophisticated git-daemon to make local HTTP GIT repository with all features.

Removed depth:1 and shallow:true. make the pipeline work.

It's compiling now, I hope it has a good ending.

So, all of the major steps ran out. then I can build the ISO, right?

I think sagitta build would build 1.4 LTS, correct? but what about Equuleus? I think isn't a rolling, but what version is it?

Edit1 sigh~ failed on Intel ICE driver stage

I may think about to purchase a cloud vps to have a try...

Details

```shell 10:11:17 Traceback (most recent call last): 10:11:17 File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 601, in urlopen 10:11:17 chunked=chunked) 10:11:17 File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 344, in _make_request 10:11:17 self._validate_conn(conn) 10:11:17 File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 846, in _validate_conn 10:11:17 conn.connect() 10:11:17 File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 358, in connect 10:11:17 ssl_context=context) 10:11:17 File "/usr/lib/python3/dist-packages/urllib3/util/ssl_.py", line 347, in ssl_wrap_socket 10:11:17 return context.wrap_socket(sock, server_hostname=server_hostname) 10:11:17 File "/usr/lib/python3.7/ssl.py", line 412, in wrap_socket 10:11:17 session=session 10:11:17 File "/usr/lib/python3.7/ssl.py", line 886, in _create 10:11:17 self.do_handshake() 10:11:17 File "/usr/lib/python3.7/ssl.py", line 1150, in do_handshake 10:11:17 self._sslobj.do_handshake() 10:11:17 OSError: [Errno 0] Error 10:11:17 10:11:17 During handling of the above exception, another exception occurred: 10:11:17 10:11:17 Traceback (most recent call last): 10:11:17 File "/usr/lib/python3/dist-packages/requests/adapters.py", line 449, in send 10:11:17 timeout=timeout 10:11:17 File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 639, in urlopen 10:11:17 _stacktrace=sys.exc_info()[2]) 10:11:17 File "/usr/lib/python3/dist-packages/urllib3/util/retry.py", line 368, in increment 10:11:17 raise six.reraise(type(error), error, _stacktrace) 10:11:17 File "/usr/lib/python3/dist-packages/six.py", line 692, in reraise 10:11:17 raise value.with_traceback(tb) 10:11:17 File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 601, in urlopen 10:11:17 chunked=chunked) 10:11:17 File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 344, in _make_request 10:11:17 self._validate_conn(conn) 10:11:17 File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 846, in _validate_conn 10:11:17 conn.connect() 10:11:17 File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 358, in connect 10:11:17 ssl_context=context) 10:11:17 File "/usr/lib/python3/dist-packages/urllib3/util/ssl_.py", line 347, in ssl_wrap_socket 10:11:17 return context.wrap_socket(sock, server_hostname=server_hostname) 10:11:17 File "/usr/lib/python3.7/ssl.py", line 412, in wrap_socket 10:11:17 session=session 10:11:17 File "/usr/lib/python3.7/ssl.py", line 886, in _create 10:11:17 self.do_handshake() 10:11:17 File "/usr/lib/python3.7/ssl.py", line 1150, in do_handshake 10:11:17 self._sslobj.do_handshake() 10:11:17 urllib3.exceptions.ProtocolError: ('Connection aborted.', OSError(0, 'Error')) 10:11:17 10:11:17 During handling of the above exception, another exception occurred: 10:11:17 10:11:17 Traceback (most recent call last): 10:11:17 File "./build-intel-ice.py", line 21, in 10:11:17 driver_archive.write_bytes(get(DRIVER_URL).content) 10:11:17 File "/usr/lib/python3/dist-packages/requests/api.py", line 75, in get 10:11:17 return request('get', url, params=params, **kwargs) 10:11:17 File "/usr/lib/python3/dist-packages/requests/api.py", line 60, in request 10:11:17 return session.request(method=method, url=url, **kwargs) 10:11:17 File "/usr/lib/python3/dist-packages/requests/sessions.py", line 535, in request 10:11:17 resp = self.send(prep, **send_kwargs) 10:11:17 File "/usr/lib/python3/dist-packages/requests/sessions.py", line 670, in send 10:11:17 history = [resp for resp in gen] if allow_redirects else [] 10:11:17 File "/usr/lib/python3/dist-packages/requests/sessions.py", line 670, in 10:11:17 history = [resp for resp in gen] if allow_redirects else [] 10:11:17 File "/usr/lib/python3/dist-packages/requests/sessions.py", line 247, in resolve_redirects 10:11:17 **adapter_kwargs 10:11:17 File "/usr/lib/python3/dist-packages/requests/sessions.py", line 648, in send 10:11:17 r = adapter.send(request, **kwargs) 10:11:17 File "/usr/lib/python3/dist-packages/requests/adapters.py", line 498, in send 10:11:17 raise ConnectionError(err, request=request) 10:11:17 requests.exceptions.ConnectionError: ('Connection aborted.', OSError(0, 'Error')) [Pipeline] } [Pipeline] // dir [Pipeline] } [Pipeline] // stage [Pipeline] } 10:11:17 Failed in branch Intel ICE driver ```

dd010101 commented 1 month ago

You can try to build ISO right now - the saggita. You can deal with equuleus later. The sagitta is 1.4.x, the equuleus is 1.3.x version equivalent. You don't need all packages for both to build ISO you can build only packages for one and build ISO for one to verify this will work.

I'm not sure if the ISO will assemble because you are missing those network drivers, there may be dependency that will fail the ISO build if Debian repistory doesn't alternative for these drivers - I have no idea if the network drivers are optional. They could be but may not be. You would see.

This is getting silly indeed you can make it work this way for sure but building packages with such unstable network long term would be painful. This depends on what your goals are and if you want to build packages in to the future then I would for sure find some proper solution. Obvislously the network is the issue so you could try to use some kind of VPN to pipe all the traffic from the local VM to another more reliable network, perhaps that would be more cost effective since you would need very powerful VPS to build everything online and that's for sure expensive long term.

MaurUppi commented 1 month ago

Thanks for your kind support all the way!

I created an ECS on the Aliyun HK region. The linux-firmware.git stage works very smoothly.... sigh... and all other bumpy issues that happened above are gone. The compilation is ongoing and waiting for a good outcome.

Update1： Intel ixgbe driver remains an issue due to Intel changing to GitHub... 15:17:09 curl: (28) Failed to connect to cyfuture.dl.sourceforge.net port 443 after 129278 ms: Couldn't connect to server It looks like what I can only do is comment out both stages? or maybe submit a PR to the source.

More details about ixgbe & ixgbevf

Details

```shell /var/lib/jenkins/workspace/linux-kernel_sagitta@libs/ba775b0b95af8dc714063b9e81a4009bd1e2fa2f5ee616b46c4b8ba44d8366cc/packages/linux-kernel/build-intel-ixgbe.sh url="https://sourceforge.net/projects/e1000/files/ixgbe%20stable/5.20.3/ixgbe-5.20.3.tar.gz" moved to : https://github.com/intel/ethernet-linux-ixgbe/releases/download/v5.21.5/ixgbe-5.21.5.tar.gz /var/lib/jenkins/workspace/linux-kernel_sagitta@libs/ba775b0b95af8dc714063b9e81a4009bd1e2fa2f5ee616b46c4b8ba44d8366cc/packages/linux-kernel/build-intel-ixgbevf.sh url="https://sourceforge.net/projects/e1000/files/ixgbevf%20stable/4.18.9/ixgbevf-4.18.9.tar.gz" Moved to https://github.com/intel/ethernet-linux-ixgbevf/releases/download/v4.20.5/ixgbevf-4.20.5.tar.gz ```

linux-firmware [Pipeline]

Details

```shell 14:33:13 Running in /var/lib/jenkins/workspace/linux-kernel_sagitta/build-amd64/packages/linux-kernel/linux-firmware [Pipeline] { [Pipeline] checkout 14:33:13 The recommended git tool is: NONE 14:33:13 No credentials specified 14:33:13 Warning: JENKINS-30600: special launcher org.jenkinsci.plugins.docker.workflow.WithContainerStep$Decorator$1@22f9feb4; decorates hudson.Launcher$LocalLauncher@6ea20c91 will be ignored (a typical symptom is the Git executable not being run inside a designated container) 14:33:13 Cloning the remote Git repository 14:33:13 Cloning repository https://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 14:33:13 > git init /var/lib/jenkins/workspace/linux-kernel_sagitta/build-amd64/packages/linux-kernel/linux-firmware # timeout=10 14:33:13 Fetching upstream changes from https://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 14:33:13 > git --version # timeout=10 14:33:13 > git --version # 'git version 2.39.5' 14:33:13 > git fetch --tags --force --progress -- https://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git +refs/heads/*:refs/remotes/origin/* # timeout=10 14:34:44 > git config remote.origin.url https://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git # timeout=10 14:34:44 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 14:34:44 Avoid second fetch 14:34:44 > git rev-parse 20231211^{commit} # timeout=10 14:34:44 Checking out Revision f2e52a1c5861fde69aee517ffaf798b630bdf36b (detached) 14:34:44 > git config core.sparsecheckout # timeout=10 14:34:44 > git checkout -f f2e52a1c5861fde69aee517ffaf798b630bdf36b # timeout=10 14:34:50 Commit message: "Merge branch 'wfx' into 'main'" 14:34:50 First time build. Skipping changelog. 14:34:50 Cleaning workspace 14:34:50 > git rev-parse --verify HEAD # timeout=10 14:34:50 Resetting working tree 14:34:50 > git reset --hard # timeout=10 14:34:50 > git clean -fdx # timeout=10 ```

dd010101 commented 1 month ago

Your information about the Intel driver sources doesn't seem to be correct, the repository you linked doesn't even have the version VyOS uses (5.20.3) - so that's not possible to use. That's why the only way is the SourceForge or Intel official website I posted above. Replacing the driver version with another is not correct. You need to use the same version otherwise unexpected things may happen. Commenting out the driver isn't good idea either since that may brake the ISO build. You should use the correct version, try the intel.com link, maybe that one will work.

For saggita: https://downloadmirror.intel.com/822710/ixgbe-5.20.3.tar.gz https://github.com/intel/ethernet-linux-ixgbevf/releases/download/v4.18.9/ixgbevf-4.18.9.tar.gz

For equuleus: https://downloadmirror.intel.com/772530/ice-1.11.14.tar.gz

The message about the move from SourceForge to GitHub is irrelevant, they say that new drivers will be on GitHub but we don't want new version, we want the version VyOS expects. That's why SourceForge is still the official way to get the given version and the note about GitHub doesn't apply for the older versions. The build is correct just you have issue with SourceForge for some reason... The SourceForge links work just fine.

MaurUppi commented 1 month ago

Your information about the Intel driver sources doesn't seem to be correct, the repository you linked doesn't even have the version VyOS uses (5.20.3) - so that's not possible to use. That's why the only way is the SourceForge or Intel official website I posted above. Replacing the driver version with another is not correct. You need to use the same version otherwise unexpected things may happen. Commenting out the driver isn't good idea either since that may brake the ISO build. You should use the correct version, try the intel.com link, maybe that one will work.

For saggita: https://downloadmirror.intel.com/822710/ixgbe-5.20.3.tar.gz https://github.com/intel/ethernet-linux-ixgbevf/releases/download/v4.18.9/ixgbevf-4.18.9.tar.gz

For equuleus: https://downloadmirror.intel.com/772530/ice-1.11.14.tar.gz

The message about the move from SourceForge to GitHub is irrelevant, they say that new drivers will be on GitHub but we don't want new version, we want the version VyOS expects. That's why SourceForge is still the official way to get the given version and the note about GitHub doesn't apply for the older versions.

OK, thanks for correcting me. I'm not aware that both bold highlighted are quite important. Meanwhile, indeed, [ixgbe-5.20.3.tar.gz] is not on Intel's GitHub site.

Here is the log of build-intel-ixgbe.sh running. It just can't get the file...

Details

``` [2024-09-22T07:14:58.750Z] + cd .. [2024-09-22T07:14:58.750Z] + ./build-intel-ixgbe.sh [2024-09-22T07:14:58.750Z] % Total % Received % Xferd Average Speed Time Time Time Current [2024-09-22T07:14:58.750Z] Dload Upload Total Spent Left Speed [2024-09-22T07:14:58.750Z] [2024-09-22T07:14:59.000Z] 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 [2024-09-22T07:14:59.001Z] 100 374 0 374 0 0 1463 0 --:--:-- --:--:-- --:--:-- 1466 [2024-09-22T07:14:59.251Z] [2024-09-22T07:14:59.251Z] 100 390 0 390 0 0 825 0 --:--:-- --:--:-- --:--:-- 825 [2024-09-22T07:14:59.251Z] 100 390 0 390 0 0 825 0 --:--:-- --:--:-- --:--:-- 0 [2024-09-22T07:14:59.501Z] [2024-09-22T07:14:59.501Z] 100 627 0 627 0 0 910 0 --:--:-- --:--:-- --:--:-- 910 [2024-09-22T07:15:00.052Z] [2024-09-22T07:15:00.052Z] 100 381 100 381 0 0 318 0 0:00:01 0:00:01 --:--:-- 318 [2024-09-22T07:15:00.052Z] [2024-09-22T07:15:01.395Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0 [2024-09-22T07:15:02.305Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:02 --:--:-- 0 [2024-09-22T07:15:03.216Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:03 --:--:-- 0 [2024-09-22T07:15:04.127Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:04 --:--:-- 0 [2024-09-22T07:15:05.037Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:05 --:--:-- 0 [2024-09-22T07:15:06.380Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:06 --:--:-- 0 [2024-09-22T07:15:07.291Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:07 --:--:-- 0 [2024-09-22T07:15:08.202Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:08 --:--:-- 0 [2024-09-22T07:15:09.112Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:09 --:--:-- 0 [2024-09-22T07:15:10.455Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:10 --:--:-- 0 [2024-09-22T07:15:11.366Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:11 --:--:-- 0 [2024-09-22T07:15:12.277Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:12 --:--:-- 0 [2024-09-22T07:15:13.187Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:13 --:--:-- 0 [2024-09-22T07:15:14.098Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:14 --:--:-- 0 [2024-09-22T07:15:15.441Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:15 --:--:-- 0 [2024-09-22T07:15:16.352Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:16 --:--:-- 0 [2024-09-22T07:15:17.262Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:17 --:--:-- 0 [2024-09-22T07:15:18.173Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:18 --:--:-- 0 [2024-09-22T07:15:19.083Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:19 --:--:-- 0 [2024-09-22T07:15:20.426Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:20 --:--:-- 0 [2024-09-22T07:15:21.337Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:21 --:--:-- 0 [2024-09-22T07:15:22.248Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:22 --:--:-- 0 [2024-09-22T07:15:23.158Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:23 --:--:-- 0 [2024-09-22T07:15:24.069Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:24 --:--:-- 0 [2024-09-22T07:15:25.412Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:25 --:--:-- 0 [2024-09-22T07:15:26.323Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:26 --:--:-- 0 [2024-09-22T07:15:27.233Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:27 --:--:-- 0 [2024-09-22T07:15:28.144Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:28 --:--:-- 0 [2024-09-22T07:15:29.055Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:29 --:--:-- 0 [2024-09-22T07:15:30.398Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:30 --:--:-- 0 [2024-09-22T07:15:31.308Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:31 --:--:-- 0 [2024-09-22T07:15:32.219Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:32 --:--:-- 0 [2024-09-22T07:15:33.130Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:33 --:--:-- 0 [2024-09-22T07:15:34.472Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:34 --:--:-- 0 [2024-09-22T07:15:35.383Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:35 --:--:-- 0 [2024-09-22T07:15:36.294Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:36 --:--:-- 0 [2024-09-22T07:15:37.204Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:37 --:--:-- 0 [2024-09-22T07:15:38.115Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:38 --:--:-- 0 [2024-09-22T07:15:39.458Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:39 --:--:-- 0 [2024-09-22T07:15:40.369Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:40 --:--:-- 0 [2024-09-22T07:15:41.280Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:41 --:--:-- 0 [2024-09-22T07:15:42.190Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:42 --:--:-- 0 [2024-09-22T07:15:43.101Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:43 --:--:-- 0 [2024-09-22T07:15:44.444Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:44 --:--:-- 0 [2024-09-22T07:15:45.355Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:45 --:--:-- 0 [2024-09-22T07:15:46.265Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:46 --:--:-- 0 [2024-09-22T07:15:47.176Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:47 --:--:-- 0 [2024-09-22T07:15:48.087Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:48 --:--:-- 0 [2024-09-22T07:15:49.430Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:49 --:--:-- 0 [2024-09-22T07:15:50.340Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:50 --:--:-- 0 [2024-09-22T07:15:51.251Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:51 --:--:-- 0 [2024-09-22T07:15:52.162Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:52 --:--:-- 0 [2024-09-22T07:15:53.505Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:53 --:--:-- 0 [2024-09-22T07:15:54.415Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:54 --:--:-- 0 [2024-09-22T07:15:55.326Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:55 --:--:-- 0 [2024-09-22T07:15:56.237Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:56 --:--:-- 0 [2024-09-22T07:15:57.147Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:57 --:--:-- 0 [2024-09-22T07:15:58.490Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:58 --:--:-- 0 [2024-09-22T07:15:59.401Z] 0 0 0 0 0 0 0 0 --:--:-- 0:00:59 --:--:-- 0 [2024-09-22T07:16:00.312Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:00 --:--:-- 0 [2024-09-22T07:16:01.222Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:01 --:--:-- 0 [2024-09-22T07:16:02.133Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:02 --:--:-- 0 [2024-09-22T07:16:03.476Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:03 --:--:-- 0 [2024-09-22T07:16:04.387Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:04 --:--:-- 0 [2024-09-22T07:16:05.297Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:05 --:--:-- 0 [2024-09-22T07:16:06.208Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:06 --:--:-- 0 [2024-09-22T07:16:07.119Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:07 --:--:-- 0 [2024-09-22T07:16:08.462Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:08 --:--:-- 0 [2024-09-22T07:16:09.372Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:09 --:--:-- 0 [2024-09-22T07:16:10.283Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:10 --:--:-- 0 [2024-09-22T07:16:11.194Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:11 --:--:-- 0 [2024-09-22T07:16:12.104Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:12 --:--:-- 0 [2024-09-22T07:16:13.447Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:13 --:--:-- 0 [2024-09-22T07:16:14.358Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:14 --:--:-- 0 [2024-09-22T07:16:15.269Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:15 --:--:-- 0 [2024-09-22T07:16:16.179Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:16 --:--:-- 0 [2024-09-22T07:16:17.522Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:17 --:--:-- 0 [2024-09-22T07:16:18.433Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:18 --:--:-- 0 [2024-09-22T07:16:19.344Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:19 --:--:-- 0 [2024-09-22T07:16:20.254Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:20 --:--:-- 0 [2024-09-22T07:16:21.165Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:21 --:--:-- 0 [2024-09-22T07:16:22.508Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:22 --:--:-- 0 [2024-09-22T07:16:23.418Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:23 --:--:-- 0 [2024-09-22T07:16:24.329Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:24 --:--:-- 0 [2024-09-22T07:16:25.240Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:25 --:--:-- 0 [2024-09-22T07:16:26.150Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:26 --:--:-- 0 [2024-09-22T07:16:27.493Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:27 --:--:-- 0 [2024-09-22T07:16:28.404Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:28 --:--:-- 0 [2024-09-22T07:16:29.314Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:29 --:--:-- 0 [2024-09-22T07:16:30.225Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:30 --:--:-- 0 [2024-09-22T07:16:31.136Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:31 --:--:-- 0 [2024-09-22T07:16:32.479Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:32 --:--:-- 0 [2024-09-22T07:16:33.389Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:33 --:--:-- 0 [2024-09-22T07:16:34.300Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:34 --:--:-- 0 [2024-09-22T07:16:35.211Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:35 --:--:-- 0 [2024-09-22T07:16:36.121Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:36 --:--:-- 0 [2024-09-22T07:16:37.464Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:37 --:--:-- 0 [2024-09-22T07:16:38.375Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:38 --:--:-- 0 [2024-09-22T07:16:39.285Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:39 --:--:-- 0 [2024-09-22T07:16:40.196Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:40 --:--:-- 0 [2024-09-22T07:16:41.539Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:41 --:--:-- 0 [2024-09-22T07:16:42.450Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:42 --:--:-- 0 [2024-09-22T07:16:43.360Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:43 --:--:-- 0 [2024-09-22T07:16:44.271Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:44 --:--:-- 0 [2024-09-22T07:16:45.181Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:45 --:--:-- 0 [2024-09-22T07:16:46.524Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:46 --:--:-- 0 [2024-09-22T07:16:47.435Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:47 --:--:-- 0 [2024-09-22T07:16:48.346Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:48 --:--:-- 0 [2024-09-22T07:16:49.256Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:49 --:--:-- 0 [2024-09-22T07:16:50.167Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:50 --:--:-- 0 [2024-09-22T07:16:51.510Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:51 --:--:-- 0 [2024-09-22T07:16:52.420Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:52 --:--:-- 0 [2024-09-22T07:16:53.331Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:53 --:--:-- 0 [2024-09-22T07:16:54.242Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:54 --:--:-- 0 [2024-09-22T07:16:55.153Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:55 --:--:-- 0 [2024-09-22T07:16:56.495Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:56 --:--:-- 0 [2024-09-22T07:16:57.406Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:57 --:--:-- 0 [2024-09-22T07:16:58.317Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:58 --:--:-- 0 [2024-09-22T07:16:59.227Z] 0 0 0 0 0 0 0 0 --:--:-- 0:01:59 --:--:-- 0 [2024-09-22T07:17:00.570Z] 0 0 0 0 0 0 0 0 --:--:-- 0:02:00 --:--:-- 0 [2024-09-22T07:17:01.481Z] 0 0 0 0 0 0 0 0 --:--:-- 0:02:01 --:--:-- 0 [2024-09-22T07:17:02.392Z] 0 0 0 0 0 0 0 0 --:--:-- 0:02:02 --:--:-- 0 [2024-09-22T07:17:03.302Z] 0 0 0 0 0 0 0 0 --:--:-- 0:02:03 --:--:-- 0 [2024-09-22T07:17:04.213Z] 0 0 0 0 0 0 0 0 --:--:-- 0:02:04 --:--:-- 0 [2024-09-22T07:17:05.556Z] 0 0 0 0 0 0 0 0 --:--:-- 0:02:05 --:--:-- 0 [2024-09-22T07:17:06.467Z] 0 0 0 0 0 0 0 0 --:--:-- 0:02:06 --:--:-- 0 [2024-09-22T07:17:07.377Z] 0 0 0 0 0 0 0 0 --:--:-- 0:02:07 --:--:-- 0 [2024-09-22T07:17:08.288Z] 0 0 0 0 0 0 0 0 --:--:-- 0:02:08 --:--:-- 0 [2024-09-22T07:17:09.199Z] 0 0 0 0 0 0 0 0 --:--:-- 0:02:09 --:--:-- 0 [2024-09-22T07:17:09.199Z] 0 0 0 0 0 0 0 0 --:--:-- 0:02:10 --:--:-- 0 [2024-09-22T07:17:09.199Z] curl: (28) Failed to connect to cyfuture.dl.sourceforge.net port 443 after 129278 ms: Couldn't connect to server ```

dd010101 commented 1 month ago

Does the intel.com link work for you? Then you could use the intel.com as source.

Ideally fork the https://github.com/dd010101/vyos-build and change the links there and then fill your GIT URL into Jenkins linux-kernel Pipeline in the http://YOUR_HOST:8080/job/linux-kernel/configure.

MaurUppi commented 1 month ago

Does the intel.com link work for you? Then you could use the intel.com as source.

Ideally fork the https://github.com/dd010101/vyos-build and change the links there and then fill your GIT URL into Jenkins linux-kernel Pipeline in the http://YOUR_HOST:8080/job/linux-kernel/configure.

YES, I tied both links that you provided. It's downloadable, so I just changed both .sh files directly.

I think the reason why failed is probably an issue of a certain mirror site (cyfuture.dl.sourceforge.net) of Sourceforge. It auto-directs the access from Asia/HK to there; your place may redirect you to a different but works one.

Update1: confirmed; I tried to change the mirror site manually on the Sourceforge website from cyfuture to PhoenixNAP (Phoenix, AZ, US), it works!

Thus, maybe export to set env would work? I don't know it yet, asking ChatGPT...

dd010101 commented 1 month ago

To change the URL you need to fork the vyos-build and commit the changes and then use your own repository instead of the provided, as I wrote above. There is no way to make direct changes since the code you trying to modify is pulled on fly during build inside docker container thus you don't have access to it before nor during the build unless you have your own repository as the source for the Jenkins definition of Pipeline/Jenkinsfile.

I'm not sure what you trying to do with ENV.

MaurUppi commented 1 month ago

To change the URL you need to fork the vyos-build and commit the changes and then use your own repository instead of the provided, as I wrote above. There is no way to make direct changes since the code you trying to modify is pulled on fly during build inside docker container thus you don't have access to it before nor during the build unless you have your own repository as the source for the Jenkins definition of Pipeline/Jenkinsfile.

I'm not sure what you trying to do with ENV.

Thanks for the recommendation, yep. That's the only proper way to do so. Tried to change the .sh file in docker container may just a lazy workaround.

You can skip my comment about the idea of export env.

Thanks for your patience all the time.

Please help me sort it out to see if the steps below are correct.

  1. fork vyos-build & vyos-jenkins
  2. Make necessary changes on vyos-build to fit my case.
  3. Follow 1- to 8- script provided by vyos-jenkins repo to make the ISO. Question: Is there anything I should change accordingly?
  4. anything that I missed?

BTW, I do have som confusion about the Complete build script for sagitta on https://vyos.tnyzeq.icu/ vs. 8-step methodology on vyos-jenkins repo.

dd010101 commented 1 month ago

There is easier way. Since you care only about the issue in the linux-kernel package/job, then you only need to:

1) Fork https://github.com/dd010101/vyos-build. 2) Modify & commit & push the changes inside of packages/linux-kernel/ directory to your own repository.

Now you have prepared linux-kernel and you can use the regular vyos-jenkins steps. After step 6-provision-project-jobs.sh you need to inject your own vyos-build fork but only for the linux-kernel package/job/Pipeline. So as example:

1) Take your GIT URL like https://github.com/MaurUppi/vyos-build. 2) Navigate to the linux-kernel package/job/Pipeline in Jenkins http://YOUR_JENKINS_HOST:8080/job/linux-kernel/configure. 3) Override the GIT URL to yours under Branch Sources -> Git -> Project Repository 4) Save

Now you can continue with step 7 or manually trigger the build for linux-kernel Package/job/Pipeline.

That's all you need to make it work for the linux-kernel changes. Thus you don't need to fork or modify the vyos-jenkins.

dd010101 commented 1 month ago

The https://vyos.tnyzeq.icu/ is the result of this project - if you complete all steps then you basically get what the repository at the URL gives you. Thus if you use the build method of this repository at the given URL you bypass the need for all steps, you don't need vyos-jenkins at all since the vyos-jenkins is used to generate what the repository at the URL gives you.

With this method you are using packages that are being build by my own Jenkins and that's why it's suggested to use it only for testing and people are encouraged to build their own since if your use my binaries then you need to trust me that I don't do malicious things.

Thus if you use vyos-jenkins then you are building everything from the sources you can see. If you use the repository at given URL then you are using pre-built binaries where you don't see the source. Well you can see the source here but you can't be sure that's the whole picture unless you trust me and you shouldn't trust me or anyone else with this sort of thing if you don't need to - and you don't need to, you can build your own... How big deal this is depends where/how you use VyOS.

MaurUppi commented 1 month ago

There is easier way. Since you care only about the issue in the linux-kernel package/job, then you only need to:

  1. Fork https://github.com/dd010101/vyos-build.
  2. Modify & commit & push the changes inside of packages/linux-kernel/ directory to your own repository.

Now you have prepared linux-kernel and you can use the regular vyos-jenkins steps. After step 6-provision-project-jobs.sh you need to inject your own vyos-build fork but only for the linux-kernel package/job/Pipeline. So as example:

  1. Take your GIT URL like https://github.com/MaurUppi/vyos-build.
  2. Navigate to the linux-kernel package/job/Pipeline in Jenkins http://YOUR_JENKINS_HOST:8080/job/linux-kernel/configure.
  3. Override the GIT URL to yours under Branch Sources -> Git -> Project Repository
  4. Save

Now you can continue with step 7 or manually trigger the build for linux-kernel Package/job/Pipeline.

That's all you need to make it work for the linux-kernel changes. Thus you don't need to fork or modify the vyos-jenkins.

Details

Well, before Override the GIT URL to mine: ![image](https://github.com/user-attachments/assets/28439856-4708-47d1-b0dd-81f7ca5f79d9) After **changing** the Project Repository URL (https://github.com/dd010101/vyos-build.git) to mind (https://github.com/MaurUppi/vyos-build.git) and **save** Jenkins going to **Scan Multibranch Pipeline Log** ![image](https://github.com/user-attachments/assets/88aace8b-55d3-4f5e-986f-a59e2888519e) **Then I lost what should be there. Did I do something wrong?** ![image](https://github.com/user-attachments/assets/ef41c052-4434-4e8e-88fc-8e5db02d7c62) Something going wrong when run ./7-build-project-jobs.sh

Details

```shell root@iZj6cc9fbhtk6pdbhxjb1eZ:/opt/vyos-jenkins# ./7-build-project-jobs.sh ################################################# # Unofficial VyOS package mirror installer v1.0 # ################################################# -- Currently executing '7-build-project-jobs.sh' -- [ OK ] Connected to Jenkins successfully. Building jobs in Jenkins... Total number of jobs: 45 Concurrent jobs: 4 (Can be overridden by setting the CONCURRENT_JOBS_COUNT environment variable) [ Completed ] Package: aws-gateway-load-balancer-tunnel-handler - Branch: sagitta [ Completed ] Package: ddclient - Branch: sagitta [ Completed ] Package: dropbear - Branch: sagitta [ Completed ] Package: ethtool - Branch: sagitta [ Completed ] Package: frr - Branch: sagitta [ Completed ] Package: hostap - Branch: sagitta [ Completed ] Package: hsflowd - Branch: sagitta [ Completed ] Package: hvinfo - Branch: sagitta [ Completed ] Package: ipaddrcheck - Branch: sagitta [ Completed ] Package: isc-dhcp - Branch: sagitta [ Completed ] Package: keepalived - Branch: sagitta [ Completed ] Package: libnss-mapuser - Branch: sagitta [ Not Started ] Package: libnss-tacplus - Branch: sagitta [ Not Started ] Package: libpam-radius-auth - Branch: sagitta [ Not Started ] Package: libvyosconfig - Branch: sagitta curl: (22) The requested URL returned error: 404 parse error: Invalid numeric literal at line 1, column 10 parse error: Invalid numeric literal at line 1, column 10 parse error: Invalid numeric literal at line 1, column 10 ERROR: No such job 'linux-kernel/sagitta'; perhaps you meant 'net-snmp/sagitta'? < ----- Look at here. curl: (22) The requested URL returned error: 404 parse error: Invalid numeric literal at line 1, column 10 curl: (22) The requested URL returned error: 404 parse error: Invalid numeric literal at line 1, column 10 curl: (22) The requested URL returned error: 404 parse error: Invalid numeric literal at line 1, column 10 curl: (22) The requested URL returned error: 404 parse error: Invalid numeric literal at line 1, column 10 curl: (22) The requested URL returned error: 404 parse error: Invalid numeric literal at line 1, column 10 curl: (22) The requested URL returned error: 404 parse error: Invalid numeric literal at line 1, column 10 curl: (22) The requested URL returned error: 404 parse error: Invalid numeric literal at line 1, column 10 curl: (22) The requested URL returned error: 404 parse error: Invalid numeric literal at line 1, column 10 ^C ```

Em,,,, I think I know what's going wrong cause branch issues

dd010101 commented 1 month ago

You need to update all branches, you updated only current branch of the vyos-build. The linux-kernel uses only the sagitta/equuleus branch that's why Jenkins Pipeline is empty since you have no sagitta/equuleus branch.

Switch the branch to sagitta, update the files, commit, push... Switch then to equuleus branch, update the files, commit, push...

MaurUppi commented 1 month ago

Hi @dd010101

Thank you for your kind support throughout my journey of ISO buildup. Now that it's done finally, it should be ready to write to USB by Rufus. I hope everything runs well and will be installed smoothly on the bare metal system.

Is there anything you may remind me of before or after installation?

vyos-1.4.0-release-20240923-iso-amd64.iso 22-Sep-2024 16:59 503316480

dd010101 commented 1 month ago

I'm glad you did make it work in the end 👍. Once you get the ISO then there is nothing special. The whole purpose of this project is just to make VyOS build-able from source, since there is no official way as of now, there is nothing more after that - it's just VyOS. Of course make sure you test the functionality of the image before you use it somewhere critical.