search

perfsonar / project

The perfSONAR project's primary wiki and issue tracker.
Apache License 2.0
52 stars 10 forks source link

Improve mirror resilience #1289

Open apertome opened 3 years ago

apertome commented 3 years ago

We several different places in docs/scripts/etc that use a URL to a specific mirror for repo access.

We don't have a shortage of mirrors, and once you have the perfSONAR repo installed, you should be able to use mirrors via yum, but for initial installation and some other cases, mirror-specific URLs are provided, which end up being a single point of failure.

For instance, at the moment, linux.mirrors.es.net is down, and we have reports people can't install via netinstall. Also some of my automated qa testing tools are failing.

In these cases you don't have the benefit of the mirrorlist, since you have not installed our repo and thus yum can't take advantage of them. Or perhaps tools other than yum are being used, in which case yum's mirror capabilities don't help.

We should consider some mirrors with RR DNS or something similar to avoid these single failure points. Another thing that might help would be adding multiple mirror URLs to the docs anywhere something is being referenced directly via http.

apertome commented 3 years ago

Let's also use this ticket to track places where a certain mirror is referenced directly. Here are a couple.

  1. http://docs.perfsonar.net/install_centos.html#step-1-configure-yum references http://software.internet2.edu/rpms/el7/x86_64/latest/packages/perfSONAR-repo-0.10-1.noarch.rpm -- this is both a specific mirror AND references a specific version of the repo (repo-latest would be ideal)
  2. http://docs.perfsonar.net/install_debian.html#step-1-configure-apt references http://downloads.perfsonar.net/debian/perfsonar-release.list and http://downloads.perfsonar.net/debian/perfsonar-official.gpg.key
mfeit-internet2 commented 3 years ago

I think I mentioned this in a meeting at some point, but I'll put it in here:

GitHub takes care of the heavy lifting for making sure they're reliably available and getting there from R&E isn't a problem. We put the LS cache hints there; we should probably do the same with the mirror list and maybe the perfSONAR repo file(s) as well.