search

ocaml / infrastructure

WIki to hold the information about the machine resources available to OCaml.org
40 stars 9 forks source link

Issues on benchmark ci #68

Closed rjbou closed 5 months ago

rjbou commented 10 months ago

These days, I've seen several buggy behaviour with benchmarks on opam:

shakthimaan commented 10 months ago

Thanks for raising an issue. A recent system upgrade is causing these behaviors.. We are currently troubleshooting the Docker and benchmark failures, and we will keep you posted on any further updates.

avsm commented 8 months ago

How's this troubleshooting going?

punchagan commented 8 months ago

I've not yet had a chance to look into this in detail, but I've created an issue for it that we will track on the current-bench repo.

The docker issues were because of the disk running out of inodes and we have mitigated the issue by switching to a larger disk, though we haven't yet figured out the reason for the docker overlay2 layers not being garbage collected, even when they seem to be no longer used.

  • No bench job associated to a PR

Some of the missed PRs were because the service was unstable due to the disk space (inode) issues. This should be resolved now.

tmattio commented 5 months ago

My understanding is that the issue has been addressed. Closing now, but please re-open if that's not the case.