rust-lang / rust

Empowering everyone to build reliable and efficient software.
https://www.rust-lang.org
Other
98.77k stars 12.77k forks source link

CI: use free runners for i686-gnu jobs #133256

Open MarcoIeni opened 2 days ago

MarcoIeni commented 2 days ago

I'm trying to switch jobs to free runners without impacting the overall time of the auto build. I don't think we can convert all of them. Let's see.

try-job: i686-gnu-1 try-job: i686-gnu-2 try-job: i686-gnu-nopt-1 try-job: i686-gnu-nopt-2

rustbot commented 2 days ago

r? @Mark-Simulacrum

rustbot has assigned @Mark-Simulacrum. They will have a look at your PR within the next two weeks and either review your PR or reassign to another reviewer.

Use r? to explicitly pick a reviewer

MarcoIeni commented 2 days ago

@bors try

bors commented 2 days ago

:hourglass: Trying commit d7063fd6089f887a4dd78bdac0a8068dae86a68e with merge 25f24b95d13b7d70626401bae2b57ef7deec156d...

rust-log-analyzer commented 2 days ago

The job x86_64-fuchsia failed! Check out the build log: (web) (plain)

Click to see the possible cause of the failure (guessed by this bot) ```plain file:.git/config remote.origin.url=https://github.com/rust-lang-ci/rust file:.git/config remote.origin.fetch=+refs/heads/*:refs/remotes/origin/* file:.git/config gc.auto=0 file:.git/config http.https://github.com/.extraheader=AUTHORIZATION: basic *** file:.git/config branch.try.remote=origin file:.git/config branch.try.merge=refs/heads/try file:.git/config remote.upstream.fetch=+refs/heads/*:refs/remotes/upstream/* file:.git/config submodule.library/backtrace.active=true file:.git/config submodule.library/backtrace.url=https://github.com/rust-lang/backtrace-rs.git file:.git/config submodule.library/stdarch.active=true --- + .jiri_root/bin/jiri import -name=integration -revision=9f632bb7446d5a6af2998f1a0ebdb4b8ea2f4511 -overwrite=true flower https://fuchsia.googlesource.com/integration + '[' -d .git ']' + .jiri_root/bin/jiri update -autoupdate=false [18:05:33.012] Updating all projects ##[warning]You are running out of disk space. The runner will stop working when the machine runs out of disk space. Free space left: 38 MB [P36838 18:09:45.356 storage.go:264 W] [fetch 104/118] Transient error: writing to the output instance file: write /checkout/obj/fuchsia/.cipd/tmp/dl_2478416212/sjZmyTU7KYDu: no space left on device [P36838 18:09:45.357 storage.go:264 W] [fetch 106/118] Transient error: writing to the output instance file: write /checkout/obj/fuchsia/.cipd/tmp/dl_2478416212/s98HnAZuLkdg: no space left on device [P36838 18:09:45.357 storage.go:264 W] [fetch 103/118] Transient error: writing to the output instance file: write /checkout/obj/fuchsia/.cipd/tmp/dl_2478416212/elQly4WSSEgi: no space left on device [P36838 18:09:45.357 storage.go:264 W] [fetch 100/118] Transient error: writing to the output instance file: write /checkout/obj/fuchsia/.cipd/tmp/dl_2478416212/4_r18fIa-f7k: no space left on device [P36838 18:09:45.482 client.go:1915 E] [unzip 69/118] Failed to install fuchsia/third_party/llvm/fuchsia-arm64 in "prebuilt/third_party/llvm/fuchsia-arm64": write /checkout/obj/fuchsia/.cipd/pkgs/77/ttoFpAUIoEIB/lib/libLLVMAnalysis.a: no space left on device (and 1999 other errors) [P36838 18:09:47.206 client.go:1915 E] [unzip 81/118] Failed to install fuchsia/third_party/qemu/linux-amd64 in "prebuilt/third_party/qemu/linux-x64": write /checkout/obj/fuchsia/.cipd/pkgs/80/NcaG6U2aOHbz/bin/qemu-system-x86_64: no space left on device (and 127 other errors) [P36838 18:09:48.137 storage.go:264 W] [fetch 107/118] Transient error: writing to the output instance file: write /checkout/obj/fuchsia/.cipd/tmp/dl_2478416212/LSgXUDlbCnIq: no space left on device [P36838 18:09:48.138 storage.go:264 W] [fetch 103/118] Transient error: writing to the output instance file: write /checkout/obj/fuchsia/.cipd/tmp/dl_2478416212/elQly4WSSEgi: no space left on device ##[error]No space left on device : '/home/runner/runners/2.320.0/_diag/pages/e17189b4-f9c4-45dc-b90b-78a5fa3d4911_1809d5dc-a3cc-53bc-e0c6-ba85f797c512_1.log' ##[error]No space left on device : '/home/runner/runners/2.320.0/_diag/pages/e17189b4-f9c4-45dc-b90b-78a5fa3d4911_d01b891a-ff12-5b28-f14d-b305f129d9e5_1.log' ```
bors commented 2 days ago

:broken_heart: Test failed - checks-actions

MarcoIeni commented 2 days ago

@bors try

bors commented 2 days ago

:hourglass: Trying commit c50f770f5396347b34bc7b48d03131d4fc63e0bb with merge c1f0153acfd3122e7bcd85ca6d465488d2396ef6...

bors commented 1 day ago

:broken_heart: Test failed - checks-actions

rust-log-analyzer commented 1 day ago

The job dist-arm-linux failed! Check out the build log: (web) (plain)

Click to see the possible cause of the failure (guessed by this bot) ```plain file:.git/config remote.origin.url=https://github.com/rust-lang-ci/rust file:.git/config remote.origin.fetch=+refs/heads/*:refs/remotes/origin/* file:.git/config gc.auto=0 file:.git/config http.https://github.com/.extraheader=AUTHORIZATION: basic *** file:.git/config branch.try.remote=origin file:.git/config branch.try.merge=refs/heads/try file:.git/config remote.upstream.fetch=+refs/heads/*:refs/remotes/upstream/* file:.git/config submodule.library/backtrace.active=true file:.git/config submodule.library/backtrace.url=https://github.com/rust-lang/backtrace-rs.git file:.git/config submodule.library/stdarch.active=true ```
MarcoIeni commented 1 day ago

image

MarcoIeni commented 1 day ago

@bors try

bors commented 1 day ago

:hourglass: Trying commit 3ada89aa37574f2803668d17e684cae8a2af52ab with merge 7e36573e96ee7cb25c7ed0aac0bd855cfc22d90f...

rust-log-analyzer commented 1 day ago

A job failed! Check out the build log: (web) (plain)

Click to see the possible cause of the failure (guessed by this bot) ```plain ```
bors commented 1 day ago

:broken_heart: Test failed - checks-actions

MarcoIeni commented 1 day ago

image

MarcoIeni commented 1 day ago

@bors try

bors commented 1 day ago

:hourglass: Trying commit 535184d9292614c26aa2722cec2d3e1faf02331c with merge 940450a274f0a885bed41898076b6a61c34ba7ad...

bors commented 1 day ago

:sunny: Try build successful - checks-actions Build commit: 940450a274f0a885bed41898076b6a61c34ba7ad (940450a274f0a885bed41898076b6a61c34ba7ad)

MarcoIeni commented 1 day ago

They take too long, I'll try to split them image

MarcoIeni commented 1 day ago

Actually the dist-arm-linux job can't be split, because it's a dist job. So I need to remove it from this PR

EDIT: x86_64-gnu-distcheck is also hard to split because it only runs one task (the distcheck)

EDIT2: fuchsia doesn't seem it can be parallelized because it's just a build

MarcoIeni commented 1 day ago

I tried to split the jobs in an ugly way, just to test if it's feasible to split the jobs

MarcoIeni commented 1 day ago

@bors try

bors commented 1 day ago

:hourglass: Trying commit 08e429eeb64d85fa48f35e7d6cc40a7afcd3587d with merge a023249afa93c2450f672ea5a265339436e06b33...

rust-log-analyzer commented 1 day ago

A job failed! Check out the build log: (web) (plain)

Click to see the possible cause of the failure (guessed by this bot) ```plain adding extra environment variable DIST_TRY_BUILD adding extra environment variable SCRIPT adding extra environment variable TOOLSTATE_PUBLISH linux builder detected, using docker to run the build ##[error]Unable to process file command 'env' successfully. ##[error]Invalid format ' tests/ui' ```
bors commented 1 day ago

:broken_heart: Test failed - checks-actions

MarcoIeni commented 1 day ago

@bors try

bors commented 1 day ago

:hourglass: Trying commit fc30a49f474a9fa81a9a0401563f7d0c0b7287e1 with merge 18d6348ee59cf3a22a4f24a8c9615d5de6d16809...

rust-log-analyzer commented 1 day ago

A job failed! Check out the build log: (web) (plain)

Click to see the possible cause of the failure (guessed by this bot) ```plain file:.git/config remote.origin.url=https://github.com/rust-lang-ci/rust file:.git/config remote.origin.fetch=+refs/heads/*:refs/remotes/origin/* file:.git/config gc.auto=0 file:.git/config http.https://github.com/.extraheader=AUTHORIZATION: basic *** file:.git/config branch.try.remote=origin file:.git/config branch.try.merge=refs/heads/try file:.git/config remote.upstream.fetch=+refs/heads/*:refs/remotes/upstream/* file:.git/config submodule.library/backtrace.active=true file:.git/config submodule.library/backtrace.url=https://github.com/rust-lang/backtrace-rs.git file:.git/config submodule.library/stdarch.active=true ```
bors commented 1 day ago

:broken_heart: Test failed - checks-actions

MarcoIeni commented 1 day ago

@bors try

bors commented 1 day ago

:hourglass: Trying commit 448219e691be6207bb15ce3a132ec25918bf90cc with merge 9ace94cd06cc7bf3c6c11d8ea880c1a9131b700c...

bors commented 1 day ago

:sunny: Try build successful - checks-actions Build commit: 9ace94cd06cc7bf3c6c11d8ea880c1a9131b700c (9ace94cd06cc7bf3c6c11d8ea880c1a9131b700c)

MarcoIeni commented 12 hours ago

Splitting the tasks in the jobs.yml did't work. So I have now created two new dockerfiles to split the tasks. Hopefully we find a mechanism to reduce code duplication (of the other docker steps). E.g. by introducing a way to override the SCRIPT env variable of the dockerfile from the jobs.yml file for example

MarcoIeni commented 12 hours ago

@bors try

bors commented 12 hours ago

:hourglass: Trying commit dfb67e74c7e4338dbc7f150ed7c16f9deb296935 with merge 1abf837664763d8588b93bc70ea37be7d08a470d...

bors commented 10 hours ago

:sunny: Try build successful - checks-actions Build commit: 1abf837664763d8588b93bc70ea37be7d08a470d (1abf837664763d8588b93bc70ea37be7d08a470d)

MarcoIeni commented 9 hours ago

Yay, not bad! I'll balance them better image