search

opnsense / core

OPNsense GUI, API and systems backend
https://opnsense.org/
BSD 2-Clause "Simplified" License
3.36k stars 755 forks source link

`opnsense-bootstrap`: Very slow download speed for packages #8036

Open fdcastel opened 2 weeks ago

fdcastel commented 2 weeks ago

I'm getting painfully slow download speeds for packages through opnsense-bootstrap.

Is there a way to check which mirror it's pulling from?

And any option to switch to a different one? 

Number of packages to be installed: 168

The process will require 1 GiB more space.
173 MiB to be downloaded.
[1/168] Fetching py311-sqlite3-3.11.10_7.pkg: 100%   37 KiB  37.6kB/s    00:01
[2/168] Fetching py311-anyio-4.6.1.pkg: 100%  188 KiB 192.1kB/s    00:01
[3/168] Fetching unbound-1.22.0_1.pkg: 100%    1 MiB  86.3kB/s    00:16
[4/168] Fetching php82-session-8.2.24.pkg: 100%   38 KiB  38.8kB/s    00:01
[5/168] Fetching wpa_supplicant-2.11_2.pkg: 100%  547 KiB  40.0kB/s    00:14
[6/168] Fetching mpdecimal-4.0.0.pkg: 100%  141 KiB 144.8kB/s    00:01
[7/168] Fetching flock-2.37.2_1.pkg: 100%   21 KiB  21.6kB/s    00:01
[8/168] Fetching filterlog-0.7_1.pkg: 100%    8 KiB   7.8kB/s    00:01
[9/168] Fetching dpinger-3.3.pkg: 100%   10 KiB  10.0kB/s    00:01
[10/168] Fetching py311-cryptography-42.0.8_3,1.pkg: 100%    1 MiB  60.8kB/s    00:18
[11/168] Fetching lighttpd-1.4.76.pkg: 100%  309 KiB 316.3kB/s    00:01
[12/168] Fetching php82-pear-Crypt_CHAP-1.5.0_1.pkg: 100%    6 KiB   6.4kB/s    00:01
[13/168] Fetching libidn2-2.3.7.pkg: 100%  133 KiB 135.8kB/s    00:01
[14/168] Fetching py311-service-identity-24.1.0.pkg: 100%   20 KiB  20.9kB/s    00:01
[15/168] Fetching opnsense-update-24.7.6.pkg: 100%   34 KiB  34.4kB/s    00:01
[16/168] Fetching hostapd-2.11_1.pkg: 100%  247 KiB 126.5kB/s    00:02
[17/168] Fetching py311-pandas-2.0.3_2,1.pkg: 100%   12 MiB  64.0kB/s    03:22
[18/168] Fetching py311-sniffio-1.3.1.pkg: 100%   12 KiB  12.2kB/s    00:01
[19/168] Fetching py311-bottleneck-1.3.8_1.pkg: 100%  114 KiB  58.4kB/s    00:02
[20/168] Fetching flowd-0.9.1_5.pkg: 100%   73 KiB  74.5kB/s    00:01
[21/168] Fetching py311-httpcore-1.0.6.pkg: 100%  107 KiB 109.9kB/s    00:01
[22/168] Fetching py311-hyperframe-6.0.0.pkg: 100%   22 KiB  22.1kB/s    00:01
[23/168] Fetching openssl-3.0.15_1,1.pkg: 100%    6 MiB  62.5kB/s    01:43
[24/168] Fetching py311-pycparser-2.22.pkg: 100%  213 KiB 217.7kB/s    00:01
[25/168] Fetching boost-libs-1.85.0.pkg: 100%   14 MiB  59.9kB/s    04:04
[26/168] Fetching monit-5.34.2.pkg: 100%  305 KiB 104.0kB/s    00:03
[27/168] Fetching py311-numpy-1.25.0_7,1.pkg: 100%    7 MiB  65.7kB/s    01:53
[28/168] Fetching libyaml-0.2.5.pkg: 100%   70 KiB  72.0kB/s    00:01
[29/168] Fetching py311-python-dateutil-2.9.0.pkg: 100%  293 KiB 150.0kB/s    00:02
[30/168] Fetching nettle-3.10_1.pkg: 100%  835 KiB 427.8kB/s    00:02
[31/168] Fetching lzo2-2.10_1.pkg: 100%   91 KiB  93.2kB/s    00:01
[32/168] Fetching py311-six-1.16.0_1.pkg: 100%   25 KiB  25.1kB/s    00:01
[33/168] Fetching nss-3.105.pkg: 100%    2 MiB 151.0kB/s    00:14
[34/168] Fetching dhcrelay-1.0.pkg: 100%   27 KiB  27.2kB/s    00:01
[35/168] Fetching libunistring-1.2.pkg: 100%  523 KiB 267.9kB/s    00:02
[36/168] Fetching cpdup-1.22_1.pkg: 100%   28 KiB  28.4kB/s    00:01
[37/168] Fetching php82-zlib-8.2.24.pkg: 100%   20 KiB  20.8kB/s    00:01
[38/168] Fetching php82-dom-8.2.24.pkg: 100%   67 KiB  69.0kB/s    00:01
[39/168] Fetching py311-charset-normalizer-3.3.2_1.pkg: 100%   83 KiB  84.6kB/s    00:01
[40/168] Fetching php82-simplexml-8.2.24.pkg: 100%   24 KiB  24.6kB/s    00:01
[41/168] Fetching py311-pyasn1-modules-0.4.0.pkg: 100%  261 KiB 133.8kB/s    00:02
[42/168] Fetching libiconv-1.17_1.pkg: 100%  613 KiB 627.8kB/s    00:01
[43/168] Fetching json-c-0.18.pkg: 100%   67 KiB  68.3kB/s    00:01
[44/168] Fetching easy-rsa-3.2.1_1,1.pkg: 100%   52 KiB  53.4kB/s    00:01
[45/168] Fetching libcbor-0.11.0.pkg: 100%   33 KiB  34.0kB/s    00:01
[46/168] Fetching py311-pyyaml-6.0.1.pkg: 100%  165 KiB 168.6kB/s    00:01
[47/168] Fetching choparp-20150613_1.pkg: 100%    7 KiB   7.4kB/s    00:01
[48/168] Fetching ldns-1.8.4.pkg: 100%  423 KiB 216.7kB/s    00:02
[49/168] Fetching py311-aioquic-1.2.0.pkg: 100%  214 KiB 219.0kB/s    00:01
[50/168] Fetching e2fsprogs-libuuid-1.47.1.pkg: 100%   33 KiB  34.1kB/s    00:01
[51/168] Fetching py311-setuptools-63.1.0_1.pkg: 100%    1 MiB  60.3kB/s    00:23
[52/168] Fetching py311-idna-3.10.pkg: 100%   78 KiB  79.7kB/s    00:01
[53/168] Fetching cyrus-sasl-gssapi-2.1.28.pkg: 100%   28 KiB  28.5kB/s    00:01
[54/168] Fetching openvpn-2.6.12.pkg: 100%  419 KiB 428.6kB/s    00:01
[55/168] Fetching cpustats-0.1.pkg: 100%    3 KiB   3.2kB/s    00:01
[56/168] Fetching php82-pdo-8.2.24.pkg: 100%   52 KiB  52.9kB/s    00:01
[57/168] Fetching libnghttp2-1.63.0.pkg: 100%  131 KiB 134.4kB/s    00:01
[58/168] Fetching libxml2-2.11.9.pkg: 100%  604 KiB 309.2kB/s    00:02
[59/168] Fetching krb5-1.21.3.pkg: 100%    1 MiB  57.4kB/s    00:20
[60/168] Fetching php82-curl-8.2.24.pkg: 100%   43 KiB  44.0kB/s    00:01
[61/168] Fetching py311-cffi-1.17.1.pkg: 100%  263 KiB 269.8kB/s    00:01
[62/168] Fetching icu-74.2_1,1.pkg: 100%   11 MiB  76.7kB/s    02:31
[63/168] Fetching php82-pecl-radius-1.4.0b1_2.pkg: 100%   23 KiB  23.8kB/s    00:01
[64/168] Fetching py311-httpx-0.27.2.pkg: 100%  153 KiB  52.3kB/s    00:03
[65/168] Fetching dnsmasq-2.90_2,1.pkg: 100%  246 KiB 252.4kB/s    00:01
[66/168] Fetching py311-packaging-24.1.pkg: 100%   95 KiB  96.8kB/s    00:01
[67/168] Fetching py311-netaddr-1.3.0.pkg: 100%    2 MiB 121.3kB/s    00:13
[68/168] Fetching libmcrypt-2.5.8_4.pkg: 100%  119 KiB  40.6kB/s    00:03
[69/168] Fetching rrdtool-1.9.0.pkg: 100%  215 KiB 220.2kB/s    00:01
[70/168] Fetching dhcp6c-20241008.pkg: 100%   67 KiB  68.5kB/s    00:01
[71/168] Fetching libargon2-20190702_1.pkg: 100%   63 KiB  64.3kB/s    00:01
[72/168] Fetching php82-phalcon-5.8.0.pkg: 100%    2 MiB 370.5kB/s    00:05
[73/168] Fetching php82-mbstring-8.2.24.pkg: 100%  791 KiB 270.1kB/s    00:03
[74/168] Fetching radvd-2.19_4.pkg: 100%   50 KiB  51.6kB/s    00:01
[75/168] Fetching isc-dhcp44-server-4.4.3P1_2.pkg: 100%    1 MiB 768.7kB/s    00:02
[76/168] Fetching py311-pytz-2024.2,1.pkg: 100%  159 KiB  40.7kB/s    00:04
[77/168] Fetching py311-pysocks-1.7.1_1.pkg: 100%   30 KiB  30.7kB/s    00:01
[78/168] Fetching ntp-4.2.8p18.pkg: 100%  558 KiB  63.5kB/s    00:09
[79/168] Fetching syslog-ng-4.8.1_1.pkg: 100%    1 MiB  97.1kB/s    00:11
[80/168] Fetching py311-markupsafe-2.1.5_1.pkg: 100%   18 KiB  18.8kB/s    00:01
[81/168] Fetching libpsl-0.21.5_1.pkg: 100%   60 KiB  61.8kB/s    00:01
[82/168] Fetching py311-requests-2.32.3.pkg: 100%  113 KiB 115.5kB/s    00:01
[83/168] Fetching py311-attrs-24.2.0.pkg: 100%   98 KiB 100.6kB/s    00:01
[84/168] Fetching libfido2-1.15.0.pkg: 100%  207 KiB  52.9kB/s    00:04
[85/168] Fetching php82-ldap-8.2.24.pkg: 100%   34 KiB  34.6kB/s    00:01
[86/168] Fetching py311-sortedcontainers-2.4.0.pkg: 100%   48 KiB  48.9kB/s    00:01
fichtner commented 2 weeks ago

Not much anyone can do here, sorry. It’s probably neither opnsense-bootstrap nor pkg causing this. Most likely a configuration issue in core.

deajan commented 1 week ago

Had the same issues with IPv6 enabled on WAN link. Try to temporarily disable it in order to outrule IPv6 problems. Perhaps some of the mirrors don't provide proper dual stack.

fdcastel commented 1 week ago

I've turned off ipv6 on this system to avoid exactly problems like this.

But this time, the problem is happening with ipv4.

Thanks @deajan, for the feedback.