search

dd010101 / vyos-jenkins

Scripts for building custom VyOS stream (1.5 circinus) packages/images. Also legacy scripts for building frozen 1.3 equuleus/1.4 sagitta packages/images.
98 stars 32 forks source link

6-provision-project-jobs.sh looped #45

Closed ashimov closed 3 months ago

ashimov commented 3 months ago

Hello!In Jenkins all packages is builded but in console i see that packages start build many times image image image

dd010101 commented 3 months ago

Are you using latest version of the scripts?

Can you please show the Build History of vyos-strongswan/equuleus job? You can find it in the detail of vyos-strongswan/equuleus, in URL like http://YOUR_HOST:8080/job/vyos-strongswan/job/equuleus/.

Also it would be helpful if you would posted the JSON result of API request of URL http://YOUR_HOST:8080/job/vyos-strongswan/job/equuleus/api/json?pretty=true.

ashimov commented 3 months ago

I'm using latest version of the scripts vyos-strongswan/equuleus job is clean,why?) image

UPD: i find log that failure of vyos-strongswan

Legacy code started this job. No cause information is available [Wed Jul 31 10:37:24 UTC 2024] Starting branch indexing...

git --version # timeout=10 git --version # 'git version 2.39.2' git ls-remote --symref -- https://github.com/vyos/vyos-strongswan.git # timeout=10 Creating git repository in /var/lib/jenkins/caches/git-b6aa37515eeb21b886a97438c4236874 git init /var/lib/jenkins/caches/git-b6aa37515eeb21b886a97438c4236874 # timeout=10 Setting origin to https://github.com/vyos/vyos-strongswan.git git config remote.origin.url https://github.com/vyos/vyos-strongswan.git # timeout=10 Fetching & pruning origin... Listing remote references... git config --get remote.origin.url # timeout=10 git --version # timeout=10 git --version # 'git version 2.39.2' git ls-remote -h -- https://github.com/vyos/vyos-strongswan.git # timeout=10 Fetching upstream changes from origin git config --get remote.origin.url # timeout=10 git fetch --tags --force --progress --prune -- origin +refs/heads/:refs/remotes/origin/ # timeout=10 ERROR: [Wed Jul 31 10:38:24 UTC 2024] Could not fetch branches from source 61655632-2acc-4cf1-be05-2bd1530809a4 [Wed Jul 31 10:38:24 UTC 2024] Finished branch indexing. Indexing took 59 sec FATAL: Failed to recompute children of vyos-strongswan hudson.plugins.git.GitException: Command "git fetch --tags --force --progress --prune -- origin +refs/heads/:refs/remotes/origin/" returned status code 128: stdout: stderr: remote: Enumerating objects: 68519, done.
remote: Counting objects: 1% (1/52)
remote: Counting objects: 3% (2/52)
remote: Counting objects: 5% (3/52)
remote: Counting objects: 7% (4/52)
remote: Counting objects: 9% (5/52)
remote: Counting objects: 11% (6/52)
remote: Counting objects: 13% (7/52)
remote: Counting objects: 15% (8/52)
remote: Counting objects: 17% (9/52)
remote: Counting objects: 19% (10/52)
remote: Counting objects: 21% (11/52)
remote: Counting objects: 23% (12/52)
remote: Counting objects: 25% (13/52)
remote: Counting objects: 26% (14/52)
remote: Counting objects: 28% (15/52)
remote: Counting objects: 30% (16/52)
remote: Counting objects: 32% (17/52)
remote: Counting objects: 34% (18/52)
remote: Counting objects: 36% (19/52)
remote: Counting objects: 38% (20/52)
remote: Counting objects: 40% (21/52)
remote: Counting objects: 42% (22/52)
remote: Counting objects: 44% (23/52)
remote: Counting objects: 46% (24/52)
remote: Counting objects: 48% (25/52)
remote: Counting objects: 50% (26/52)
remote: Counting objects: 51% (27/52)
remote: Counting objects: 53% (28/52)
remote: Counting objects: 55% (29/52)
remote: Counting objects: 57% (30/52)
remote: Counting objects: 59% (31/52)
remote: Counting objects: 61% (32/52)
remote: Counting objects: 63% (33/52)
remote: Counting objects: 65% (34/52)
remote: Counting objects: 67% (35/52)
remote: Counting objects: 69% (36/52)
remote: Counting objects: 71% (37/52)
remote: Counting objects: 73% (38/52)
remote: Counting objects: 75% (39/52)
remote: Counting objects: 76% (40/52)
remote: Counting objects: 78% (41/52)
remote: Counting objects: 80% (42/52)
remote: Counting objects: 82% (43/52)
remote: Counting objects: 84% (44/52)
remote: Counting objects: 86% (45/52)
remote: Counting objects: 88% (46/52)
remote: Counting objects: 90% (47/52)
remote: Counting objects: 92% (48/52)
remote: Counting objects: 94% (49/52)
remote: Counting objects: 96% (50/52)
remote: Counting objects: 98% (51/52)
remote: Counting objects: 100% (52/52)
remote: Counting objects: 100% (52/52), done.
remote: Compressing objects: 2% (1/41)
remote: Compressing objects: 4% (2/41)
remote: Compressing objects: 7% (3/41)
remote: Compressing objects: 9% (4/41)
remote: Compressing objects: 12% (5/41)
remote: Compressing objects: 14% (6/41)
remote: Compressing objects: 17% (7/41)
remote: Compressing objects: 19% (8/41)
remote: Compressing objects: 21% (9/41)
remote: Compressing objects: 24% (10/41)
remote: Compressing objects: 26% (11/41)
remote: Compressing objects: 29% (12/41)
remote: Compressing objects: 31% (13/41)
remote: Compressing objects: 34% (14/41)
remote: Compressing objects: 36% (15/41)
remote: Compressing objects: 39% (16/41)
remote: Compressing objects: 41% (17/41)
remote: Compressing objects: 43% (18/41)
remote: Compressing objects: 46% (19/41)
remote: Compressing objects: 48% (20/41)
remote: Compressing objects: 51% (21/41)
remote: Compressing objects: 53% (22/41)
remote: Compressing objects: 56% (23/41)
remote: Compressing objects: 58% (24/41)
remote: Compressing objects: 60% (25/41)
remote: Compressing objects: 63% (26/41)
remote: Compressing objects: 65% (27/41)
remote: Compressing objects: 68% (28/41)
remote: Compressing objects: 70% (29/41)
remote: Compressing objects: 73% (30/41)
remote: Compressing objects: 75% (31/41)
remote: Compressing objects: 78% (32/41)
remote: Compressing objects: 80% (33/41)
remote: Compressing objects: 82% (34/41)
remote: Compressing objects: 85% (35/41)
remote: Compressing objects: 87% (36/41)
remote: Compressing objects: 90% (37/41)
remote: Compressing objects: 92% (38/41)
remote: Compressing objects: 95% (39/41)
remote: Compressing objects: 97% (40/41)
remote: Compressing objects: 100% (41/41)
remote: Compressing objects: 100% (41/41), done.
Receiving objects: 0% (1/68519) Receiving objects: 1% (686/68519), 136.01 KiB | 257.00 KiB/s Receiving objects: 1% (802/68519), 308.01 KiB | 295.00 KiB/s Receiving objects: 1% (1094/68519), 508.01 KiB | 327.00 KiB/s Receiving objects: 1% (1302/68519), 956.01 KiB | 366.00 KiB/s Receiving objects: 2% (1371/68519), 1.16 MiB | 381.00 KiB/s
Receiving objects: 2% (1934/68519), 1.40 MiB | 394.00 KiB/s Receiving objects: 3% (2056/68519), 1.66 MiB | 406.00 KiB/s Receiving objects: 3% (2618/68519), 1.88 MiB | 408.00 KiB/s Receiving objects: 4% (2741/68519), 1.88 MiB | 408.00 KiB/s Receiving objects: 4% (3374/68519), 2.32 MiB | 441.00 KiB/s Receiving objects: 5% (3426/68519), 2.46 MiB | 428.00 KiB/s Receiving objects: 5% (3849/68519), 2.65 MiB | 428.00 KiB/s Receiving objects: 6% (4112/68519), 2.80 MiB | 409.00 KiB/s Receiving objects: 6% (4185/68519), 2.94 MiB | 390.00 KiB/s Receiving objects: 6% (4439/68519), 3.12 MiB | 242.00 KiB/s Receiving objects: 6% (4603/68519), 3.31 MiB | 228.00 KiB/s Receiving objects: 7% (4797/68519), 3.31 MiB | 228.00 KiB/s Receiving objects: 7% (4852/68519), 3.31 MiB | 228.00 KiB/s Receiving objects: 7% (5149/68519), 3.67 MiB | 200.00 KiB/s Receiving objects: 7% (5450/68519), 3.89 MiB | 205.00 KiB/s Receiving objects: 8% (5482/68519), 3.89 MiB | 205.00 KiB/s Receiving objects: 8% (5830/68519), 4.16 MiB | 200.00 KiB/s Receiving objects: 9% (6167/68519), 4.30 MiB | 209.00 KiB/s Receiving objects: 9% (6182/68519), 4.42 MiB | 214.00 KiB/s Receiving objects: 9% (6518/68519), 4.55 MiB | 260.00 KiB/s Receiving objects: 9% (6665/68519), 4.68 MiB | 231.00 KiB/s Receiving objects: 10% (6852/68519), 4.79 MiB | 227.00 KiB/s Receiving objects: 10% (7072/68519), 4.96 MiB | 217.00 KiB/s Receiving objects: 11% (7538/68519), 5.21 MiB | 218.00 KiB/s Receiving objects: 11% (7602/68519), 5.21 MiB | 218.00 KiB/s Receiving objects: 11% (7942/68519), 5.37 MiB | 219.00 KiB/s Receiving objects: 11% (8045/68519), 5.78 MiB | 235.00 KiB/s Receiving objects: 12% (8223/68519), 5.88 MiB | 254.00 KiB/s Receiving objects: 12% (8229/68519), 5.88 MiB | 254.00 KiB/s Receiving objects: 12% (8570/68519), 6.10 MiB | 242.00 KiB/s Receiving objects: 12% (8831/68519), 6.34 MiB | 239.00 KiB/s Receiving objects: 13% (8908/68519), 6.34 MiB | 239.00 KiB/s Receiving objects: 13% (9177/68519), 6.61 MiB | 234.00 KiB/s Receiving objects: 14% (9593/68519), 6.93 MiB | 254.00 KiB/s Receiving objects: 14% (9724/68519), 6.93 MiB | 254.00 KiB/s Receiving objects: 14% (9972/68519), 7.31 MiB | 293.00 KiB/s Receiving objects: 14% (10166/68519), 7.68 MiB | 324.00 KiB/s Receiving objects: 15% (10278/68519), 7.68 MiB | 324.00 KiB/s Receiving objects: 16% (10964/68519), 7.68 MiB | 324.00 KiB/s Receiving objects: 17% (11649/68519), 7.84 MiB | 332.00 KiB/s Receiving objects: 18% (12334/68519), 7.84 MiB | 332.00 KiB/s Receiving objects: 19% (13019/68519), 7.84 MiB | 332.00 KiB/s Receiving objects: 20% (13704/68519), 8.08 MiB | 355.00 KiB/s Receiving objects: 20% (13771/68519), 8.08 MiB | 355.00 KiB/s Receiving objects: 21% (14389/68519), 8.08 MiB | 355.00 KiB/s Receiving objects: 22% (15075/68519), 8.08 MiB | 355.00 KiB/s Receiving objects: 23% (15760/68519), 8.33 MiB | 378.00 KiB/s Receiving objects: 24% (16445/68519), 8.33 MiB | 378.00 KiB/s Receiving objects: 25% (17130/68519), 8.33 MiB | 378.00 KiB/s Receiving objects: 25% (17234/68519), 8.57 MiB | 398.00 KiB/s Receiving objects: 26% (17815/68519), 8.57 MiB | 398.00 KiB/s Receiving objects: 26% (18330/68519), 8.92 MiB | 401.00 KiB/s Receiving objects: 27% (18501/68519), 8.92 MiB | 401.00 KiB/s Receiving objects: 27% (18854/68519), 9.21 MiB | 385.00 KiB/s Receiving objects: 28% (19186/68519), 9.21 MiB | 385.00 KiB/s Receiving objects: 29% (19871/68519), 9.36 MiB | 369.00 KiB/s Receiving objects: 29% (19917/68519), 9.36 MiB | 369.00 KiB/s Receiving objects: 30% (20556/68519), 9.51 MiB | 367.00 KiB/s Receiving objects: 31% (21241/68519), 9.51 MiB | 367.00 KiB/s Receiving objects: 32% (21927/68519), 9.68 MiB | 354.00 KiB/s Receiving objects: 32% (21957/68519), 9.68 MiB | 354.00 KiB/s Receiving objects: 33% (22612/68519), 9.88 MiB | 343.00 KiB/s Receiving objects: 34% (23297/68519), 10.11 MiB | 340.00 KiB/s Receiving objects: 35% (23982/68519), 10.11 MiB | 340.00 KiB/s Receiving objects: 36% (24667/68519), 10.11 MiB | 340.00 KiB/s Receiving objects: 36% (25053/68519), 10.11 MiB | 340.00 KiB/s Receiving objects: 37% (25353/68519), 10.33 MiB | 348.00 KiB/s Receiving objects: 38% (26038/68519), 10.33 MiB | 348.00 KiB/s Receiving objects: 39% (26723/68519), 10.59 MiB | 371.00 KiB/s Receiving objects: 39% (27367/68519), 10.59 MiB | 371.00 KiB/s Receiving objects: 40% (27408/68519), 10.59 MiB | 371.00 KiB/s Receiving objects: 41% (28093/68519), 10.81 MiB | 380.00 KiB/s Receiving objects: 42% (28778/68519), 11.01 MiB | 395.00 KiB/s Receiving objects: 42% (29367/68519), 11.01 MiB | 395.00 KiB/s Receiving objects: 43% (29464/68519), 11.01 MiB | 395.00 KiB/s Receiving objects: 44% (30149/68519), 11.18 MiB | 400.00 KiB/s Receiving objects: 45% (30834/68519), 11.18 MiB | 400.00 KiB/s Receiving objects: 46% (31519/68519), 11.35 MiB | 400.00 KiB/s Receiving objects: 46% (31620/68519), 11.35 MiB | 400.00 KiB/s Receiving objects: 47% (32204/68519), 11.56 MiB | 409.00 KiB/s Receiving objects: 48% (32890/68519), 11.76 MiB | 409.00 KiB/s Receiving objects: 49% (33575/68519), 11.76 MiB | 409.00 KiB/s Receiving objects: 49% (33698/68519), 11.76 MiB | 409.00 KiB/s Receiving objects: 50% (34260/68519), 11.76 MiB | 409.00 KiB/s Receiving objects: 51% (34945/68519), 11.76 MiB | 409.00 KiB/s Receiving objects: 52% (35630/68519), 11.99 MiB | 408.00 KiB/s Receiving objects: 53% (36316/68519), 12.18 MiB | 402.00 KiB/s Receiving objects: 53% (36518/68519), 12.18 MiB | 402.00 KiB/s Receiving objects: 54% (37001/68519), 12.33 MiB | 377.00 KiB/s Receiving objects: 55% (37686/68519), 12.33 MiB | 377.00 KiB/s Receiving objects: 55% (38189/68519), 12.59 MiB | 391.00 KiB/s Receiving objects: 56% (38371/68519), 12.79 MiB | 392.00 KiB/s Receiving objects: 56% (38971/68519), 13.00 MiB | 401.00 KiB/s Receiving objects: 57% (39056/68519), 13.19 MiB | 409.00 KiB/s Receiving objects: 57% (39241/68519), 13.34 MiB | 392.00 KiB/s Receiving objects: 58% (39742/68519), 13.56 MiB | 398.00 KiB/s Receiving objects: 58% (40149/68519), 13.75 MiB | 390.00 KiB/s Receiving objects: 59% (40427/68519), 13.75 MiB | 390.00 KiB/s Receiving objects: 60% (41112/68519), 13.97 MiB | 393.00 KiB/s Receiving objects: 60% (41219/68519), 14.19 MiB | 398.00 KiB/s Receiving objects: 60% (41333/68519), 14.38 MiB | 384.00 KiB/s Receiving objects: 60% (41592/68519), 14.77 MiB | 380.00 KiB/s Receiving objects: 61% (41797/68519), 14.93 MiB | 370.00 KiB/s Receiving objects: 62% (42482/68519), 14.93 MiB | 370.00 KiB/s Receiving objects: 63% (43167/68519), 15.05 MiB | 364.00 KiB/s Receiving objects: 63% (43431/68519), 15.05 MiB | 364.00 KiB/s Receiving objects: 64% (43853/68519), 15.05 MiB | 364.00 KiB/s Receiving objects: 65% (44538/68519), 15.18 MiB | 344.00 KiB/s Receiving objects: 66% (45223/68519), 15.18 MiB | 344.00 KiB/s Receiving objects: 67% (45908/68519), 15.33 MiB | 335.00 KiB/s Receiving objects: 67% (46052/68519), 15.33 MiB | 335.00 KiB/s Receiving objects: 68% (46593/68519), 15.50 MiB | 326.00 KiB/s Receiving objects: 69% (47279/68519), 15.66 MiB | 321.00 KiB/s Receiving objects: 69% (47327/68519), 15.66 MiB | 321.00 KiB/s Receiving objects: 70% (47964/68519), 15.86 MiB | 323.00 KiB/s Receiving objects: 71% (48649/68519), 15.86 MiB | 323.00 KiB/s Receiving objects: 71% (48865/68519), 16.05 MiB | 318.00 KiB/s Receiving objects: 72% (49334/68519), 16.23 MiB | 315.00 KiB/s Receiving objects: 72% (49653/68519), 16.40 MiB | 319.00 KiB/s Receiving objects: 73% (50019/68519), 16.40 MiB | 319.00 KiB/s Receiving objects: 74% (50705/68519), 16.85 MiB | 366.00 KiB/s Receiving objects: 74% (50792/68519), 16.85 MiB | 366.00 KiB/s Receiving objects: 75% (51390/68519), 17.11 MiB | 391.00 KiB/s Receiving objects: 76% (52075/68519), 17.37 MiB | 408.00 KiB/s Receiving objects: 76% (52239/68519), 17.37 MiB | 408.00 KiB/s Receiving objects: 77% (52760/68519), 17.37 MiB | 408.00 KiB/s Receiving objects: 78% (53445/68519), 17.37 MiB | 408.00 KiB/s Receiving objects: 79% (54131/68519), 17.66 MiB | 440.00 KiB/s Receiving objects: 80% (54816/68519), 17.66 MiB | 440.00 KiB/s Receiving objects: 80% (55458/68519), 17.85 MiB | 434.00 KiB/s Receiving objects: 81% (55501/68519), 17.85 MiB | 434.00 KiB/s Receiving objects: 82% (56186/68519), 17.85 MiB | 434.00 KiB/s Receiving objects: 83% (56871/68519), 17.85 MiB | 434.00 KiB/s Receiving objects: 84% (57556/68519), 17.85 MiB | 434.00 KiB/s Receiving objects: 84% (57575/68519), 18.30 MiB | 445.00 KiB/s error: RPC failed; curl 92 HTTP/2 stream 5 was not closed cleanly: CANCEL (err 8) error: 8061 bytes of body are still expected Receiving objects: 85% (58242/68519), 18.30 MiB | 445.00 KiB/s fetch-pack: unexpected disconnect while reading sideband packet fatal: early EOF fatal: fetch-pack: invalid index-pack output

at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:2846)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:2185)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:635)
at jenkins.plugins.git.AbstractGitSCMSource$8.run(AbstractGitSCMSource.java:605)
at jenkins.plugins.git.AbstractGitSCMSource$8.run(AbstractGitSCMSource.java:591)
at jenkins.plugins.git.AbstractGitSCMSource.doRetrieve(AbstractGitSCMSource.java:397)
at jenkins.plugins.git.AbstractGitSCMSource.doRetrieve(AbstractGitSCMSource.java:351)
at jenkins.plugins.git.AbstractGitSCMSource.retrieve(AbstractGitSCMSource.java:591)
at jenkins.scm.api.SCMSource._retrieve(SCMSource.java:372)
at jenkins.scm.api.SCMSource.fetch(SCMSource.java:282)
at jenkins.branch.MultiBranchProject.computeChildren(MultiBranchProject.java:654)
at com.cloudbees.hudson.plugins.folder.computed.ComputedFolder.updateChildren(ComputedFolder.java:269)
at com.cloudbees.hudson.plugins.folder.computed.FolderComputation.run(FolderComputation.java:167)
at jenkins.branch.MultiBranchProject$BranchIndexing.run(MultiBranchProject.java:1057)
at hudson.model.ResourceController.execute(ResourceController.java:101)
at hudson.model.Executor.run(Executor.java:442)

Finished: FAILURE

dd010101 commented 3 months ago

Please show the Status page as well. Do you see equuleus branch there?

Also please post the JSON result of http://YOUR_HOST:8080/job/vyos-strongswan/job/equuleus/, replace the YOUR_HOST with address of the build host.

The common reason why Build History is empty: 1) Misconfiguration - like no branch was found. 2) Everything is fine - just the runs are too old or many other runs happened since and thus the runs were expired and purged as process of database maintenance.

ashimov commented 3 months ago

image http://MY_HOST:8080/job/vyos-strongswan/job/equuleus/ image

dd010101 commented 3 months ago

Seems like the branch indexing of the job failed. Thus there is no branch to be found and this results in infinite loop.

The error you posted:

error: RPC failed; curl 92 HTTP/2 stream 5 was not closed cleanly: CANCEL (err 8)
error: 8061 bytes of body are still expected
Receiving objects: 85% (58242/68519), 18.30 MiB | 445.00 KiB/s
fetch-pack: unexpected disconnect while reading sideband packet
fatal: early EOF
fatal: fetch-pack: invalid index-pack output

This is issue of GitHub servers and/or network connection. You can retry the branch indexing manually via Scan Multibranch Pipeline Now and see if that succeeds.