google / llvm-premerge-checks

CI system for premerge-testing in LLVM project
Apache License 2.0
40 stars 37 forks source link

buildkite build premerge-checks 78760 #386

Open zixu-w opened 2 years ago

zixu-w commented 2 years ago

Describe the bug Infrastructure failure: no space left on device for Windows builds:

fatal: write error: No space left on device fatal: fetch-pack: invalid index-pack output ⚠️ Warning: Checkout failed! exit status 128 (Attempt 3/3 Retrying in 2s) 🚨 Error: exit status 128

Relevant links: https://buildkite.com/llvm-project/premerge-checks/builds/78760#96cad312-5104-4fcb-924e-4aff7ad92a66

zixu-w commented 2 years ago

Manually restarted the build with the same failure: https://reviews.llvm.org/harbormaster/build/220297/

metaflow commented 2 years ago

Thank you for the report @zixu-w ! It seem that automatic workspace clear up didn't work as expected. I am looking into that. I have also removed w6 and w3 agents from a pool so this error should not affect you now.

metaflow commented 2 years ago

Trying to run "git gc" in w3 fails with error: cannot lock ref 'refs/remotes/origin/phab-diff-362741'. Looks like cleanup routine should be updated.

metaflow commented 2 years ago

similar error on w5. It looks like that we should completely wipe out checkout directory sometimes (on pre-checkout stage).