Monterey bottling

[Bo98]

This is a tracking issue on Monterey bottling process and will be used as a dump for build failures.

This year we are bottling for both x86_64 and arm64. Our upload flow cannot currently handle bottling for both at the same time - please wait for one architecture to complete and be pushed to master before starting the other architecture. If you are bottling for both at the same time, pass --macos=12,12-arm64. Do not start two independent runs at the same time.

Currently, we have six x86_64 runners and three arm64 runners.

The arm64 runners are currently running 12.0.1 RC with Xcode 13.1 RC. The x86_64 runners are also using Xcode 13.1 RC but are stuck on 12.0 beta 10 as their board ID is currently blocked from receiving further updates. I don't anticipate this will cause any issues for mass bottling however.

I will start by focussing on popular formula with a high number of dependents.

Please do not bottle something until all its dependencies have been bottled and their associated bottle commits have been pushed to master.

[BrewTestBot]

:x: @Bo98 bottle request for gdbm failed.

[carlocab]

We can probably fix gdbm at #87641.

[Bo98]

Hmm ok I'll try dodge that dep tree for now then. Would be good to get something soon though, even if that may mean fixing the current version, since gdbm has 1728 dependents.

[BrewTestBot]

:x: @Bo98 bottle request for gdbm failed.

[BrewTestBot]

:x: @Bo98 bottle request for gettext failed.

[BrewTestBot]

:x: @carlocab bottle request for m4 failed.

[Bo98]

Looks like our upload flow cannot handle bottling x86_64 and arm64 at the same time.

[BrewTestBot]

:x: @Bo98 bottle request for gettext failed.

[BrewTestBot]

:x: @Bo98 bottle request for pkg-config failed.

[BrewTestBot]

:x: @Bo98 bottle request for openssl@1.1 failed.

[BrewTestBot]

:x: @Bo98 bottle request for readline failed.

[BrewTestBot]

:x: @Bo98 bottle request for xz failed.

[BrewTestBot]

:x: @Bo98 bottle request for cmake failed.

[BrewTestBot]

:x: @Bo98 bottle request for mpdecimal failed.

[BrewTestBot]

:x: @Bo98 bottle request for icu4c failed.

[BrewTestBot]

:x: @Bo98 bottle request for libpng failed.

[BrewTestBot]

:x: @Bo98 bottle request for pcre failed.

[BrewTestBot]

:x: @Bo98 bottle request for autoconf failed.

[BrewTestBot]

:x: @Bo98 bottle request for autoconf failed.

[BrewTestBot]

:x: @Bo98 bottle request for gmp failed.

[BrewTestBot]

:x: @Bo98 bottle request for automake failed.

[Bo98]

We have a cache issue with bottle manifests. I've emptied the cache on the arm64 machines so that will cover it for now.

[BrewTestBot]

:x: @Bo98 bottle request for libtiff failed. -- #87876

[BrewTestBot]

:x: @Bo98 bottle request for libev failed.

[BrewTestBot]

:x: @Bo98 bottle request for openldap failed.

[BrewTestBot]

:x: @Bo98 bottle request for openjdk failed.

[BrewTestBot]

:x: @Bo98 bottle request for tcl-tk failed.

[Bo98]

@chenrui333 Please follow this:

This year we are bottling for both x86_64 and arm64. Our upload flow cannot currently handle bottling for both at the same time.

All of your x86_64 uploads are now stuck and retrying won't fix them.

[Bo98]

And this too:

Please do not bottle something until all its dependencies have been bottled and their associated bottle commits have been pushed to master.

[chenrui333]

Noted, sorry about the hassle. I will check out the deps before triggering new builds.

[Bo98]

I'll handle the stuck jobs now and note here what will need to be bottled again (this unfortunately means a full rebottle for all OS versions).

[Bo98]

These need full rebottles:

• terragrunt
• infracost
• tfupdate
• atlantis
• cdktf
• cfn-flip
• cfn-lint
• cloudformation-cli
• cloudformation-guard
• moto

(once all dependencies are bottled)

[Bo98]

We can probably fix gdbm at #87641.

Not sure what the best strategy for this is going to be. We're going to want to do this for several popular formulae, all of which could potentially have very long dependent testing times competing for limited (3) CI machines.

[carlocab]

I guess we can merge the patch earlier while skipping dependents in CI and not publishing bottles.

[Bo98]

Ok, we can make a list somewhere of things to go back to.

[BrewTestBot]

:x: @Bo98 bottle request for libzip failed. -- #88147

[BrewTestBot]

:x: @Bo98 bottle request for libksba failed.

[Bo98]

==> Downloading https://libzip.org/download/libzip-1.8.0.tar.xz curl: (35) error:06FFF089:digital envelope routines:CRYPTO_internal:bad key length

huh

[BrewTestBot]

:x: @Bo98 bottle request for opus failed.

[BrewTestBot]

:x: @Bo98 bottle request for xvid failed.

[BrewTestBot]

:x: @Bo98 bottle request for hello failed.

[BrewTestBot]

:x: @Bo98 bottle request for libassuan failed.

[BrewTestBot]

:x: @Bo98 bottle request for gmp failed.

[BrewTestBot]

:x: @Bo98 bottle request for isl failed.

[BrewTestBot]

:x: @Bo98 bottle request for autogen failed.

[BrewTestBot]

:x: @Bo98 bottle request for llvm failed.

[Bo98]

The job running on runner monterey-arm-2 has exceeded the maximum execution time of 60 minutes.

Oh, we don't have an option for this on the command line.

[BrewTestBot]

:x: @Bo98 bottle request for mpfr failed.

[BrewTestBot]

:x: @Bo98 bottle request for jq failed. -- #87761

[BrewTestBot]

:x: @Bo98 bottle request for libvorbis failed. -- #87860