search

conda / infrastructure

A repo to report issues and have discussions about the conda infrastructure
BSD 3-Clause "New" or "Revised" License
12 stars 15 forks source link

Indexing for the CDN seems markedly slower on some architectures than others #829

Closed h-vetinari closed 10 months ago

h-vetinari commented 1 year ago

I noticed in recent days that the indexer for osx-64 is markedly slower than for all the other arches. Most packages are available through the CDN in 15-20min, but osx often takes much longer, like 1-2h.

Not a huge issue, but noticeable during a migration (e.g. Python 3.12, Boost running at the moment).

As my most recent example (I use https://anaconda.org/conda-forge/<package>/files as a proxy; once the download number jumps from 0 to 1, it only takes a couple more minutes for the package to be available, e.g. as verified by mamba repoquery search <package> -c conda-forge -p <arch>):

image

The other architectures in this example were all available in under 15-20 minutes.

PS: @jakirkham asked me to open an issue here after asking about this on element.

h-vetinari commented 1 year ago

Two hours now:

image

jakirkham commented 1 year ago

@jezdez do you know who we should talk to about this?

jakirkham commented 1 year ago

This is being investigated: https://github.com/conda/infrastructure/issues/836#issuecomment-1758053093

jezdez commented 10 months ago

Closing as a duplicate of #836.