Firstyear / mirrorsorcerer

Mirror Sorcerer tool to magically make OpenSUSE mirror sources more magic-er
Mozilla Public License 2.0
59 stars 1 forks source link

New mirror base needs added? #9

Closed pallaswept closed 1 year ago

pallaswept commented 1 year ago

A recent package changed the default repos from download.opensuse.org to cdn.opensuse.org. I had previously run mirrorsorcerer -x and it had changed my mirrors to use mirrorcache-au (I'm in Melbourne) but this overwrote those changes. To demonstrate:


> sz lr -d
#  | Alias                      | Name                                  | Enabled | GPG Check | Refresh | Priority | Type   | URI                                                                                        | Service
---+----------------------------+---------------------------------------+---------+-----------+---------+----------+--------+--------------------------------------------------------------------------------------------+---------
 1 | CoolerControl              | CoolerControl                         | Yes     | (r ) Yes  | Yes     |   99     | rpm-md | https://dl.cloudsmith.io/public/coolercontrol/coolercontrol/rpm/opensuse/tumbleweed/x86_64 | 
 2 | CoolerControl-NoArch       | CoolerControl-NoArch                  | Yes     | (r ) Yes  | Yes     |   99     | rpm-md | https://dl.cloudsmith.io/public/coolercontrol/coolercontrol/rpm/opensuse/tumbleweed/noarch | 
 3 | CoolerControl-Source       | CoolerControl-Source                  | Yes     | (r ) Yes  | Yes     |   99     | rpm-md | https://dl.cloudsmith.io/public/coolercontrol/coolercontrol/rpm/opensuse/tumbleweed/SRPMS  | 
 4 | NVIDIA:repo-non-free       | repo-non-free                         | Yes     | (r ) Yes  | Yes     |   99     | rpm-md | https://download.nvidia.com/opensuse/tumbleweed/                                           | NVIDIA
 5 | home_lukho_copyq           | CopyQ (openSUSE_Tumbleweed)           | Yes     | (r ) Yes  | Yes     |   99     | rpm-md | https://mirrorcache-au.opensuse.org/repositories/home:/lukho:/copyq/openSUSE_Tumbleweed/   | 
 6 | home_pallaswept            | home:pallaswept (openSUSE_Tumbleweed) | Yes     | (r ) Yes  | No      |   99     | rpm-md | https://mirrorcache-au.opensuse.org/repositories/home:/pallaswept/openSUSE_Tumbleweed/     | 
 7 | nvidia                     | nvidia                                | Yes     | (r ) Yes  | Yes     |   99     | rpm-md | https://download.nvidia.com/opensuse/tumbleweed                                            | 
 8 | openSUSE:repo-non-oss      | repo-non-oss                          | Yes     | (r ) Yes  | Yes     |   99     | rpm-md | http://cdn.opensuse.org/tumbleweed//repo/non-oss                                           | openSUSE
 9 | openSUSE:repo-openh264     | repo-openh264                         | Yes     | (r ) Yes  | Yes     |   99     | rpm-md | http://codecs.opensuse.org/openh264/openSUSE_Tumbleweed                                    | openSUSE
10 | openSUSE:repo-oss          | repo-oss                              | Yes     | (r ) Yes  | Yes     |   99     | rpm-md | http://cdn.opensuse.org/tumbleweed//repo/oss                                               | openSUSE
11 | openSUSE:repo-oss-debug    | repo-oss-debug                        | No      | ----      | ----    |   99     | NONE   | http://cdn.opensuse.org/debug/tumbleweed//repo/oss                                         | openSUSE
12 | openSUSE:repo-oss-source   | repo-oss-source                       | No      | ----      | ----    |   99     | NONE   | http://cdn.opensuse.org/source/tumbleweed//repo/oss                                        | openSUSE
13 | openSUSE:update-tumbleweed | update-tumbleweed                     | Yes     | (r ) Yes  | Yes     |   99     | rpm-md | http://cdn.opensuse.org/update/tumbleweed/                                                 | openSUSE
14 | packman                    | packman                               | Yes     | (r ) Yes  | Yes     |   99     | rpm-md | https://ftp.fau.de/packman/suse/openSUSE_Tumbleweed/                                       | 

Note that I'm still set to use mirrorcache-au in the case of some OBS 'home' repos I've added, but for the official repos (ie openSUSE:*), they're now pointed at cdn.opensuse.org.

As a result, running sudo mirrorsorcerer -x finds the usual closer mirrors, but they are not applied as they are not in the 'replaceable' section of the config files:


> sudo mirrorsorcerer -x
 INFO Mirror Sorcerer 🪄 🪞 ✨ 
 INFO Profiling - mirrorcache-au.opensuse.org - 2400:8907::f03c:92ff:fe82:7bb - insufficient data
 INFO Profiling - mirrorcache-au.opensuse.org - 172.105.167.90 - time=14.981429ms
 INFO Profiling - mirrorcache-us.opensuse.org - 2a07:de40:401::65 - insufficient data
 INFO Profiling - mirrorcache-us.opensuse.org - 91.193.113.65 - time=227.952673ms
 INFO Profiling - mirrorcache-jp.opensuse.org - 2400:8902::f03c:93ff:fec8:af18 - insufficient data
 INFO Profiling - mirrorcache-jp.opensuse.org - 139.162.108.149 - time=141.946706ms
 INFO Profiling - mirrorcache-us-east.opensuse.org - 2600:3c03::f03c:93ff:fe35:8d5f - insufficient data
 INFO Profiling - mirrorcache-us-east.opensuse.org - 172.104.208.148 - time=275.853073ms
 INFO Profiling - mirrorcache-us-west.opensuse.org - 2600:3c01::f03c:93ff:fe35:1f87 - insufficient data
 INFO Profiling - mirrorcache-us-west.opensuse.org - 198.74.51.38 - time=221.906424ms
 INFO Profiling - mirrorcache-br.opensuse.org - 168.196.94.194 - time=357.885198ms
 INFO Profiling - mirrorcache-br-1.opensuse.org - 168.196.94.194 - time=357.563587ms
 INFO Profiling - mirrorcache-br-2.opensuse.org - 2804:6ab0:0:10::24 - insufficient data
 INFO Profiling - mirrorcache-br-2.opensuse.org - 200.9.155.223 - time=334.722946ms
 INFO Profiling - mirrorcache.opensuse.org - 2001:67c:2178:8::16 - insufficient data
 INFO Profiling - mirrorcache.opensuse.org - 195.135.221.140 - time=269.344253ms
 INFO Selected - https://mirrorcache-au.opensuse.org/ - time=14.981429ms
 INFO Updating zypp.conf to have safe options.
 INFO Not updating https://download.nvidia.com/opensuse/tumbleweed - not a known mirror base
 INFO Not updating https://dl.cloudsmith.io/public/coolercontrol/coolercontrol/rpm/opensuse/tumbleweed/x86_64 - not a known mirror base
 INFO Not updating https://dl.cloudsmith.io/public/coolercontrol/coolercontrol/rpm/opensuse/tumbleweed/noarch - not a known mirror base
 INFO Not updating https://dl.cloudsmith.io/public/coolercontrol/coolercontrol/rpm/opensuse/tumbleweed/SRPMS - not a known mirror base
 INFO Not updating https://ftp.fau.de/packman/suse/openSUSE_Tumbleweed/ - not a known mirror base
 INFO Not updating https://download.nvidia.com/opensuse/tumbleweed/ - not a known mirror base
 INFO Not updating http://cdn.opensuse.org/tumbleweed//repo/oss - not a known mirror base
 INFO Not updating http://cdn.opensuse.org/debug/tumbleweed//repo/oss - not a known mirror base
 INFO Not updating http://cdn.opensuse.org/source/tumbleweed//repo/oss - not a known mirror base
 INFO Not updating http://cdn.opensuse.org/tumbleweed//repo/non-oss - not a known mirror base
 INFO Not updating http://codecs.opensuse.org/openh264/openSUSE_Tumbleweed - not a known mirror base
 INFO Not updating http://cdn.opensuse.org/update/tumbleweed/ - not a known mirror base

I guess OpenSUSE are doing something new with their infrastructure. There's some mention of it over here where those packages originated but nothing in the official doco so I'm not entirely sure what's going on here. Hopefully you're more across this than I am, I just thought I should bring it up since it's effectively 'breaking' mirrorsorcerer at the moment.

I hope this is helpful and thanks to you and firstyear for helping to provide us Aussies with a faster mirror and an easy way to use it :)

Firstyear commented 1 year ago

No problem at all! I just did some basic testing and found the CDN was slower (and less reliable) that mc-au.o.o, so I'm going to add cdn.o.o to replaceable (rather than it being an option for the mirror itself).

Hope that helps!

pallaswept commented 1 year ago

Thanks mate, smart move testing it out, your solution sounds perfect.

Firstyear commented 1 year ago

And of course, if you have any other issues at all, feel free to open a new issue or pr. So glad that you appreciate the mirrors :)