ocurrent / obuilder

Experimental "docker build" alternative using btrfs/zfs snapshots
Apache License 2.0
60 stars 17 forks source link

Some builds fail with "Build ended without setting a log" #71

Open kit-ty-kate opened 3 years ago

kit-ty-kate commented 3 years ago
Building on x86-bm-8.ocamllabs.io
[...]
/: (run (shell "opam init --reinit --config ~/.opamrc-sandbox -ni"))
Uncaught exception: (Failure "Build ended without setting a log!")
2021-06-15 22:14.54: Job failed: Failed: Internal error

Full log: https://opam.ci.ocaml.org/github/ocaml/opam-repository/commit/ab3fb4525702c8331aa69fddcc5c3c4dbdb9730b/variant/opam-2.0,distributions,debian-unstable,caqti-driver-sqlite3.1.2.3

talex5 commented 3 years ago

The logs show:

Jun 15 22:14:06 sd-148465 ocluster-worker[2964049]: 2021-06-15 22:14.06       obuilder [INFO] Pruning 100 items (of 100 requested)
Jun 15 22:14:06 sd-148465 ocluster-worker[2964049]: 2021-06-15 22:14.06    application [INFO] Exec "btrfs" "subvolume" "delete"
Jun 15 22:14:06 sd-148465 ocluster-worker[2964049]:                                                "--"
Jun 15 22:14:06 sd-148465 ocluster-worker[2964049]:                                                "/var/cache/obuilder/result/e90b2df40147532fc6612cfa132adbaf49ec21e7b822433fc5a8a902e110f3b3"
Jun 15 22:14:06 sd-148465 ocluster-worker[2964049]: 2021-06-15 22:14.06    application [INFO] Exec "btrfs" "subvolume" "snapshot"
Jun 15 22:14:06 sd-148465 ocluster-worker[2964049]:                                                "--"
Jun 15 22:14:06 sd-148465 ocluster-worker[2964049]:                                                "/var/cache/obuilder/result/e90b2df40147532fc6612cfa132adbaf49ec21e7b822433fc5a8a902e110f3b3"
Jun 15 22:14:06 sd-148465 ocluster-worker[2964049]:                                                "/var/cache/obuilder/result-tmp/b57a85ab37df52062626d00bf547d9f288bc2ce427a4711c2086105ce4980e2e"
Jun 15 22:14:07 sd-148465 ocluster-worker[2964049]: 2021-06-15 22:14.07         worker [INFO] Exec(git-reset): "git" "-C"
Jun 15 22:14:07 sd-148465 ocluster-worker[2964049]:                                           "/var/cache/obuilder/ocluster/git/opam-repository.git-b322f7b18d276db68487afc3dfc5a5befdd45818"
Jun 15 22:14:07 sd-148465 ocluster-worker[2964049]:                                           "reset" "--hard"
Jun 15 22:14:07 sd-148465 ocluster-worker[2964049]:                                           "23f96e8a287e3b9e43d1c6c5b2ae13aadf0e4fa6"
Jun 15 22:14:07 sd-148465 ocluster-worker[2342808]: ERROR: Could not statfs: No such file or directory
Jun 15 22:14:07 sd-148465 ocluster-worker[2964049]: 2021-06-15 22:14.07       obuilder [INFO] Build "b57a85ab37df52062626d00bf547d9f288bc2ce427a4711c2086105ce4980e2e" error: (Failure
Jun 15 22:14:07 sd-148465 ocluster-worker[2964049]:    "\"btrfs\" \"subvolume\" \"snapshot\" \"--\"\
Jun 15 22:14:07 sd-148465 ocluster-worker[2964049]:   \n\"/var/cache/obuilder/result/e90b2df40147532fc6612cfa132adbaf49ec21e7b822433fc5a8a902e110f3b3\"\
Jun 15 22:14:07 sd-148465 ocluster-worker[2964049]:   \n\"/var/cache/obuilder/result-tmp/b57a85ab37df52062626d00bf547d9f288bc2ce427a4711c2086105ce4980e2e\" failed with exit status 1")
...
Jun 15 22:14:54 sd-148465 ocluster-worker[2964049]: 2021-06-15 22:14.54         worker [WARNING] Build failed: (Failure "Build ended without setting a log!")
Jun 15 22:14:54 sd-148465 ocluster-worker[2964049]: 2021-06-15 22:14.54      capnp-rpc [WARNING] Uncaught exception: (Failure "Build ended without setting a log!")
Jun 15 22:14:54 sd-148465 ocluster-worker[2964049]: 2021-06-15 22:14.54      capnp-rpc [WARNING] Uncaught exception: (Failure "Build ended without setting a log!")

So, we tried to copy a base image just after deleting it.

kit-ty-kate commented 3 years ago

Happened again in https://opam.ci.ocaml.org/github/ocaml/opam-repository/commit/6cc883e033320dba8b67969cb113a6f1edd2d0bf/variant/opam-2.1,distributions,centos-8,cstruct-lwt.6.0.1,tests