search

anydistro / bxt

Next generation repository maintenance tool (WIP)
GNU Affero General Public License v3.0
0 stars 4 forks source link

Daemon hangs on big files upload #134

Open LordTermor opened 3 months ago

romangg commented 2 months ago

@oberon-manjaro Did this happen to you too?

fhdk commented 1 month ago

Repost of data posted in matrix channel.

I have updated the bxtctl source to handle more errors and to catch unexpected errors as well.

With the sorting - descending by size - I expected a 413 but instead i got

Single commit of one package 492MB

[main U:2] $ poetry run bxtctl -commit testing/extra/x86_64
Uploading repo: 'testing/extra/x86_64'
Sending package... vmware-workstation-17.6.0-1-x86_64.pkg.tar.zst
Error: 0. Message: {'Unexpected Response': SSLError(MaxRetryError("HTTPSConnectionPool(host='bxt.staging.manjaro.org', port=443):
Max retries exceeded with url: /api/packages/commit (Caused by SSLError(SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:2406)')))"))}

The error code is set by me when I get an unexpected response or an unexpected error.

fhdk commented 1 month ago

Posted to the testing service at manjaro.org

On Fri 2024-10-04 18:22 I revisited this for a quick test

When I post large files I get that strange error message. For testing purpose I removed my timeout

18:13:15 ± [fh@tiger] (py: bxtctl-J8vlmj3L-py3.12) .../manjaro-bxt/bxtctl
[main U:2] $ poetry run bxtctl -commit testing/extra/x86_64
Uploading repo: 'testing/extra/x86_64'
Sending package... vmware-workstation-17.6.0-1-x86_64.pkg.tar.zst
Error: 0. Message: {'Unexpected Response': SSLError(MaxRetryError("HTTPSConnectionPool(host='bxt.staging.manjaro.org', port=443): Max retries exceeded with url: /api/packages/commit (Caused by SSLError(SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:2406)')))"))}
18:13:37 ± [fh@tiger] (py: bxtctl-J8vlmj3L-py3.12) .../manjaro-bxt/bxtctl
[main U:2] $ poetry run bxtctl -commit testing/extra/x86_64
Uploading repo: 'testing/extra/x86_64'
Sending package... vmware-workstation-17.6.0-1-x86_64.pkg.tar.zst
Error: 0. Message: {'Unexpected Response': SSLError(MaxRetryError("HTTPSConnectionPool(host='bxt.staging.manjaro.org', port=443): Max retries exceeded with url: /api/packages/commit (Caused by SSLError(SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:2406)')))"))}

So using the process of elimination I tested where I could succesfully upload and by removing the large files from my dummy repo

18:13:45 ± [fh@tiger] (py: bxtctl-J8vlmj3L-py3.12) .../manjaro-bxt/bxtctl
[main U:2] $ poetry run bxtctl -commit testing/extra/x86_64
Uploading repo: 'testing/extra/x86_64'
Sending package... dotnet-sdk-bin-8.0.8.sdk402-1-x86_64.pkg.tar.zst
Error: 0. Message: {'Unexpected Response': SSLError(MaxRetryError("HTTPSConnectionPool(host='bxt.staging.manjaro.org', port=443): Max retries exceeded with url: /api/packages/commit (Caused by SSLError(SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:2406)')))"))}

I came under 256MB and the first commit is a success.

18:14:29 ± [fh@tiger] (py: bxtctl-J8vlmj3L-py3.12) .../manjaro-bxt/bxtctl
[main U:2] $ poetry run bxtctl -commit testing/extra/x86_64
Uploading repo: 'testing/extra/x86_64'
Sending package... microsoft-edge-dev-bin-128.0.2739.5-1-x86_64.pkg.tar.zst
Sending package... azuredatastudio-bin-1.48.1-1-x86_64.pkg.tar.zst

First package is success - second hangs indefinately...

fhdk commented 1 month ago

Tested on a local docker production instance

Sat 2024-10-05 12:08 Testing on a local production instance I get

11:59:21 ± [fh@tiger] (py: bxtctl-J8vlmj3L-py3.12) .../manjaro-bxt/bxtctl
[main U:2] $ poetry run bxtctl
(bxtctl@bxt.staging.manjaro.org) $ cfg
bxt service  : http://tiger.net.nix.dk
bxt username : default
password: 
(default@tiger.net.nix.dk) $ exit

12:03:27 ± [fh@tiger] (py: bxtctl-J8vlmj3L-py3.12) .../manjaro-bxt/bxtctl
[main U:2] $ poetry run bxtctl -commit testing/extra/x86_64
Uploading repo: 'testing/extra/x86_64'
Sending package... azuredatastudio-bin-1.48.1-1-x86_64.pkg.tar.zst (1728122636)
Sending package... teamviewer-15.55.3-1-x86_64.pkg.tar.zst (1728122637)
Sending package... postman-bin-11.10.0-1-x86_64.pkg.tar.zst (1728122638)
'visual-studio-code-bin-1.93.1-1-x86_64.pkg.tar.zst' has no signature... skipping
Sending package... proton-mail-1.0.6-1-x86_64.pkg.tar.zst (1728122640)

And the log from the local production instance

12:02:21 ± [fh@tiger] .../manjaro-bxt/bxt
[master] $ docker compose up production
[+] Running 1/0
 ✔ Container bxt-production-1  Created                                                                   0.0s 
Attaching to production-1
production-1  | [2024-10-05 10:02:29.580547][debug]: Pool: Counted links for 0 paths
production-1  | [2024-10-05 10:03:58.294966][debug]: Pool: Moving file from /tmp/bxt/azuredatastudio-bin-1.48.1-1-x86_64.pkg.tar.zst to /app/persistence/box/pool/overlay/azuredatastudio-bin-1.48.1-1-x86_64.pkg.tar.zst
production-1  | [2024-10-05 10:03:58.295008][debug]: Pool: Adding new link count for /app/persistence/box/pool/overlay/azuredatastudio-bin-1.48.1-1-x86_64.pkg.tar.zst
production-1  | [2024-10-05 10:03:58.295063][debug]: Pool: Moving signature file from /tmp/bxt//azuredatastudio-bin-1.48.1-1-x86_64.pkg.tar.zst.sig to /app/persistence/box/pool//overlay//azuredatastudio-bin-1.48.1-1-x86_64.pkg.tar.zst.sig
production-1  | [2024-10-05 10:03:58.303538][trace]: User  commited a transaction: 0 packages added, 0 packages deleted
production-1  | [2024-10-05 10:04:00.441794][debug]: Pool: Moving file from /tmp/bxt/teamviewer-15.55.3-1-x86_64.pkg.tar.zst to /app/persistence/box/pool/overlay/teamviewer-15.55.3-1-x86_64.pkg.tar.zst
production-1  | [2024-10-05 10:04:00.441828][debug]: Pool: Adding new link count for /app/persistence/box/pool/overlay/teamviewer-15.55.3-1-x86_64.pkg.tar.zst
production-1  | [2024-10-05 10:04:00.441873][debug]: Pool: Moving signature file from /tmp/bxt//teamviewer-15.55.3-1-x86_64.pkg.tar.zst.sig to /app/persistence/box/pool//overlay//teamviewer-15.55.3-1-x86_64.pkg.tar.zst.sig
production-1  | [2024-10-05 10:04:00.450111][trace]: User  commited a transaction: 0 packages added, 0 packages deleted
production-1  | [2024-10-05 10:04:02.605731][debug]: Pool: Moving file from /tmp/bxt/postman-bin-11.10.0-1-x86_64.pkg.tar.zst to /app/persistence/box/pool/overlay/postman-bin-11.10.0-1-x86_64.pkg.tar.zst
production-1  | [2024-10-05 10:04:02.605771][debug]: Pool: Adding new link count for /app/persistence/box/pool/overlay/postman-bin-11.10.0-1-x86_64.pkg.tar.zst
production-1  | [2024-10-05 10:04:02.605832][debug]: Pool: Moving signature file from /tmp/bxt//postman-bin-11.10.0-1-x86_64.pkg.tar.zst.sig to /app/persistence/box/pool//overlay//postman-bin-11.10.0-1-x86_64.pkg.tar.zst.sig
production-1  | [2024-10-05 10:04:02.623348][trace]: User  commited a transaction: 0 packages added, 0 packages deleted
production-1  | [2024-10-05 10:04:03.597065][info]: Exporter: "testing/extra/x86_64" export into the package manager format started
fhdk commented 1 month ago

Test on a local docker production instance

Posting the same file to a local docker container (docker compose up production) using http (not TLS) produce a a 413.

10:00:03 ± [fh@tiger] (py: bxtctl-J8vlmj3L-py3.12) .../manjaro-bxt/bxtctl
[main U:2] $ poetry run bxtctl -commit testing/extra/x86_64
Uploading repo: 'testing/extra/x86_64'
Sending package... vmware-workstation-17.6.0-1-x86_64.pkg.tar.zst (1728201628)
Error: 413. Message:

Posting to the the deployed staging instance using https - I don't get the 413 - instead I get a TLS error.

Earlies tests (friday as mentioned above) with the large vmware package targeting the live staging instance produces a SSL/TLS error

18:13:15 ± [fh@tiger] (py: bxtctl-J8vlmj3L-py3.12) .../manjaro-bxt/bxtctl
[main U:2] $ poetry run bxtctl -commit testing/extra/x86_64
Uploading repo: 'testing/extra/x86_64'
Sending package... vmware-workstation-17.6.0-1-x86_64.pkg.tar.zst
Error: 0. Message: {'Unexpected Response': SSLError(MaxRetryError("HTTPSConnectionPool(host='bxt.staging.manjaro.org', port=443): Max retries exceeded with url: /api/packages/commit (Caused by SSLError(SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:2406)')))"))}
fhdk commented 1 month ago

The testing repo used is a copy of my custom repo at https://uex.dk/repos/nixrepo/x86_64

The files is served with bxtctl in descending order by filesize (meaning - the largest package is uploaded first)

poetry run bxtctl -commit testing/extra/x86_64

The repo filelist as 

10:25:36 ± [fh@tiger] (py: bxtctl-J8vlmj3L-py3.12) .../manjaro-bxt/bxtctl
[main U:2] $ ls -lhS dummy-repo/testing/extra/x86_64/
total 2,0G
-rw-r--r-- 1 fh fh 492M 16 sep 08:51 vmware-workstation-17.6.0-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh 262M 26 sep 08:55 dotnet-sdk-bin-8.0.8.sdk402-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh 243M  6 okt 08:50 azuredatastudio-bin-1.49.1-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh 221M  6 okt 08:51 microsoft-edge-dev-bin-131.0.2863.0-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh 144M 27 jul 14:25 teamviewer-15.55.3-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh 132M  6 okt 08:50 postman-bin-11.14.0-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh 125M  6 okt 09:10 visual-studio-code-bin-1.94.0-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh  94M  6 okt 08:59 proton-mail-1.0.6-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh  42M  6 okt 08:52 nordvpn-bin-3.19.0-2-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh  34M 10 aug 09:45 lib32-vulkan-amdgpu-pro-24.10_1787253-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh  32M 10 aug 09:45 vulkan-amdgpu-pro-24.10_1787253-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh  30M 26 sep 08:55 dotnet-runtime-bin-8.0.8.sdk402-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh  17M 10 aug 09:45 amdgpu-pro-oglp-24.10_1787253-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh  17M  7 maj 09:09 buuf-icons-for-plasma-r5.1d7b2bf-2-any.pkg.tar.zst
-rw-r--r-- 1 fh fh  17M 10 aug 09:45 lib32-amdgpu-pro-oglp-24.10_1787253-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh  11M 26 sep 08:55 aspnet-runtime-bin-8.0.8.sdk402-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh 9,1M 26 sep 08:55 dotnet-targeting-pack-bin-8.0.8.sdk402-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh 8,7M  6 okt 09:08 gruvbox-plus-icon-theme-git-5.5.0.r1961.g262aa8c-1-any.pkg.tar.zst
-rw-r--r-- 1 fh fh 8,3M 11 apr 11:24 repoctl-0.22.2-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh 4,5M 10 aug 09:45 amf-amdgpu-pro-24.10_1787253-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh 2,9M 26 sep 08:56 aspnet-targeting-pack-bin-8.0.8.sdk402-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh 2,8M  9 maj 11:49 surfshark-vpn-cli-bin-1.1.0-4-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh 2,2M 26 sep 08:55 netstandard-targeting-pack-bin-8.0.8.sdk402-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh 1,8M 23 aug 17:48 psion-r19.94772c5-1-any.pkg.tar.zst
-rw-r--r-- 1 fh fh 1,8M 10 aug 10:49 ipscan-3.9.1-3-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh 278K 13 apr 09:40 gruvbox-dark-gtk-1.0.2-1-any.pkg.tar.zst
-rw-r--r-- 1 fh fh 264K  2 apr  2024 utterly-round-plasma-style-2.1-3-any.pkg.tar.zst
-rw-r--r-- 1 fh fh 177K 26 sep 08:55 dotnet-host-bin-8.0.8.sdk402-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh 138K 13 apr 09:40 xcursor-simp1e-rose-pine-moon-20230817-3-any.pkg.tar.zst
-rw-r--r-- 1 fh fh 138K 13 apr 09:40 xcursor-simp1e-rose-pine-dawn-20230817-3-any.pkg.tar.zst
-rw-r--r-- 1 fh fh 135K 13 apr 09:39 xcursor-simp1e-gruvbox-light-20230817-3-any.pkg.tar.zst
-rw-r--r-- 1 fh fh 135K 13 apr 09:39 xcursor-simp1e-gruvbox-dark-20230817-3-any.pkg.tar.zst
-rw-r--r-- 1 fh fh  87K  1 okt 10:29 bxtctl-0.6alpha-4-any.pkg.tar.zst
-rw-r--r-- 1 fh fh  39K  6 okt 09:09 brother-hl-l8260cdw-1.5.0-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh  26K  6 okt 08:52 modprobed-db-2.48-1-any.pkg.tar.zst
-rw-r--r-- 1 fh fh  22K  2 jun 10:02 vmware-keymaps-1.0-3-any.pkg.tar.zst
-rw-r--r-- 1 fh fh  20K 13 sep 17:33 udev-usb-sync-0.12-1-any.pkg.tar.zst
-rw-r--r-- 1 fh fh  19K  4 aug 18:32 manjaro-get-iso-0.10-1-any.pkg.tar.zst
-rw-r--r-- 1 fh fh  119  6 okt 09:12 amdgpu-pro-oglp-24.10_1787253-1-x86_64.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 amf-amdgpu-pro-24.10_1787253-1-x86_64.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 aspnet-runtime-bin-8.0.8.sdk402-1-x86_64.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 aspnet-targeting-pack-bin-8.0.8.sdk402-1-x86_64.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 azuredatastudio-bin-1.49.1-1-x86_64.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 brother-hl-l8260cdw-1.5.0-1-x86_64.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 buuf-icons-for-plasma-r5.1d7b2bf-2-any.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 bxtctl-0.6alpha-4-any.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 dotnet-host-bin-8.0.8.sdk402-1-x86_64.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 dotnet-runtime-bin-8.0.8.sdk402-1-x86_64.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 dotnet-sdk-bin-8.0.8.sdk402-1-x86_64.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 dotnet-targeting-pack-bin-8.0.8.sdk402-1-x86_64.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 gruvbox-dark-gtk-1.0.2-1-any.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 gruvbox-plus-icon-theme-git-5.5.0.r1961.g262aa8c-1-any.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 ipscan-3.9.1-3-x86_64.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 lib32-amdgpu-pro-oglp-24.10_1787253-1-x86_64.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 lib32-vulkan-amdgpu-pro-24.10_1787253-1-x86_64.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 manjaro-get-iso-0.10-1-any.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 microsoft-edge-dev-bin-131.0.2863.0-1-x86_64.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 modprobed-db-2.48-1-any.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 netstandard-targeting-pack-bin-8.0.8.sdk402-1-x86_64.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 nordvpn-bin-3.19.0-2-x86_64.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 postman-bin-11.14.0-1-x86_64.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 proton-mail-1.0.6-1-x86_64.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 psion-r19.94772c5-1-any.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 repoctl-0.22.2-1-x86_64.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 surfshark-vpn-cli-bin-1.1.0-4-x86_64.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 teamviewer-15.55.3-1-x86_64.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 udev-usb-sync-0.12-1-any.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 utterly-round-plasma-style-2.1-3-any.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 visual-studio-code-bin-1.94.0-1-x86_64.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 vmware-keymaps-1.0-3-any.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 vmware-workstation-17.6.0-1-x86_64.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 vulkan-amdgpu-pro-24.10_1787253-1-x86_64.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 xcursor-simp1e-gruvbox-dark-20230817-3-any.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 xcursor-simp1e-gruvbox-light-20230817-3-any.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 xcursor-simp1e-rose-pine-dawn-20230817-3-any.pkg.tar.zst.sig
-rw-r--r-- 1 fh fh  119  6 okt 09:12 xcursor-simp1e-rose-pine-moon-20230817-3-any.pkg.tar.zst.sig
fhdk commented 1 month ago

Using a local production container to test.

First I removed the packages from bxtd - from my previous test - using the web interface (just to see the logging)

10:00:03 ± [fh@tiger] (py: bxtctl-J8vlmj3L-py3.12) .../manjaro-bxt/bxtctl
[main U:2] $ poetry run bxtctl -commit testing/extra/x86_64
Uploading repo: 'testing/extra/x86_64'
Sending package... vmware-workstation-17.6.0-1-x86_64.pkg.tar.zst (1728201628)
Error: 413. Message:

After removing the vmware-workstation package and rerun bxtctl

10:33:07 ± [fh@tiger] (py: bxtctl-J8vlmj3L-py3.12) .../manjaro-bxt/bxtctl
[main U:2] $ poetry run bxtctl -commit testing/extra/x86_64
Uploading repo: 'testing/extra/x86_64'
Sending package... dotnet-sdk-bin-8.0.8.sdk402-1-x86_64.pkg.tar.zst (1728203705)
Error: 413. Message:

After removing the dotnet-sdk package and rerun bxtctl

10:35:04 ± [fh@tiger] (py: bxtctl-J8vlmj3L-py3.12) .../manjaro-bxt/bxtctl
[main U:2] $ poetry run bxtctl -commit testing/extra/x86_64
Uploading repo: 'testing/extra/x86_64'
Sending package... azuredatastudio-bin-1.49.1-1-x86_64.pkg.tar.zst (1728203804)
Sending package... microsoft-edge-dev-bin-131.0.2863.0-1-x86_64.pkg.tar.zst (1728203805)
Sending package... teamviewer-15.55.3-1-x86_64.pkg.tar.zst (1728203806)
Sending package... postman-bin-11.14.0-1-x86_64.pkg.tar.zst (1728203807)
Sending package... visual-studio-code-bin-1.94.0-1-x86_64.pkg.tar.zst (1728203808)
Sending package... proton-mail-1.0.6-1-x86_64.pkg.tar.zst (1728203809)
Sending package... nordvpn-bin-3.19.0-2-x86_64.pkg.tar.zst (1728203810)
Sending package... lib32-vulkan-amdgpu-pro-24.10_1787253-1-x86_64.pkg.tar.zst (1728203811)
Sending package... vulkan-amdgpu-pro-24.10_1787253-1-x86_64.pkg.tar.zst (1728203812)

And the service is now hung.

The console log from the bxtd instance

09:56:08 ± [fh@tiger] .../manjaro-bxt/bxt
[master] $ docker compose up production
[+] Running 1/0
 ✔ Container bxt-production-1  Created                                                                   0.0s 
Attaching to production-1
production-1  | [2024-10-06 07:56:28.660627][debug]: Pool: Counted links for 3 paths
production-1  | [2024-10-06 07:57:20.256648][debug]: Pool: Decrementing link count for /app/persistence/box/pool/overlay/azuredatastudio-bin-1.48.1-1-x86_64.pkg.tar.zst
production-1  | [2024-10-06 07:57:20.256695][debug]: Pool: No more links for /app/persistence/box/pool/overlay/azuredatastudio-bin-1.48.1-1-x86_64.pkg.tar.zst, removing
production-1  | [2024-10-06 07:57:20.256938][debug]: Pool: Removed file /app/persistence/box/pool/overlay/azuredatastudio-bin-1.48.1-1-x86_64.pkg.tar.zst
production-1  | [2024-10-06 07:57:20.256981][debug]: Pool: Removed signature file /app/persistence/box/pool/overlay/azuredatastudio-bin-1.48.1-1-x86_64.pkg.tar.zst.sig
production-1  | [2024-10-06 07:57:20.257002][debug]: Pool: Decrementing link count for /app/persistence/box/pool/overlay/postman-bin-11.10.0-1-x86_64.pkg.tar.zst
production-1  | [2024-10-06 07:57:20.257009][debug]: Pool: No more links for /app/persistence/box/pool/overlay/postman-bin-11.10.0-1-x86_64.pkg.tar.zst, removing
production-1  | [2024-10-06 07:57:20.257135][debug]: Pool: Removed file /app/persistence/box/pool/overlay/postman-bin-11.10.0-1-x86_64.pkg.tar.zst
production-1  | [2024-10-06 07:57:20.257166][debug]: Pool: Removed signature file /app/persistence/box/pool/overlay/postman-bin-11.10.0-1-x86_64.pkg.tar.zst.sig
production-1  | [2024-10-06 07:57:20.257183][debug]: Pool: Decrementing link count for /app/persistence/box/pool/overlay/teamviewer-15.55.3-1-x86_64.pkg.tar.zst
production-1  | [2024-10-06 07:57:20.257189][debug]: Pool: No more links for /app/persistence/box/pool/overlay/teamviewer-15.55.3-1-x86_64.pkg.tar.zst, removing
production-1  | [2024-10-06 07:57:20.257301][debug]: Pool: Removed file /app/persistence/box/pool/overlay/teamviewer-15.55.3-1-x86_64.pkg.tar.zst
production-1  | [2024-10-06 07:57:20.257343][debug]: Pool: Removed signature file /app/persistence/box/pool/overlay/teamviewer-15.55.3-1-x86_64.pkg.tar.zst.sig
production-1  | [2024-10-06 07:57:20.272792][trace]: User  commited a transaction: 0 packages added, 0 packages deleted
production-1  | [2024-10-06 07:57:25.667213][info]: Exporter: "testing/extra/x86_64" export into the package manager format started
production-1  | [2024-10-06 07:57:25.679258][info]: Exporter: "testing/extra/x86_64" export finished
production-1  | [2024-10-06 08:36:47.384547][debug]: Pool: Moving file from /tmp/bxt/azuredatastudio-bin-1.49.1-1-x86_64.pkg.tar.zst to /app/persistence/box/pool/overlay/azuredatastudio-bin-1.49.1-1-x86_64.pkg.tar.zst
production-1  | [2024-10-06 08:36:47.384595][debug]: Pool: Adding new link count for /app/persistence/box/pool/overlay/azuredatastudio-bin-1.49.1-1-x86_64.pkg.tar.zst
production-1  | [2024-10-06 08:36:47.384665][debug]: Pool: Moving signature file from /tmp/bxt//azuredatastudio-bin-1.49.1-1-x86_64.pkg.tar.zst.sig to /app/persistence/box/pool//overlay//azuredatastudio-bin-1.49.1-1-x86_64.pkg.tar.zst.sig
production-1  | [2024-10-06 08:36:47.397412][trace]: User  commited a transaction: 0 packages added, 0 packages deleted
production-1  | [2024-10-06 08:36:50.482468][debug]: Pool: Moving file from /tmp/bxt/microsoft-edge-dev-bin-131.0.2863.0-1-x86_64.pkg.tar.zst to /app/persistence/box/pool/overlay/microsoft-edge-dev-bin-131.0.2863.0-1-x86_64.pkg.tar.zst
production-1  | [2024-10-06 08:36:50.482505][debug]: Pool: Adding new link count for /app/persistence/box/pool/overlay/microsoft-edge-dev-bin-131.0.2863.0-1-x86_64.pkg.tar.zst
production-1  | [2024-10-06 08:36:50.482559][debug]: Pool: Moving signature file from /tmp/bxt//microsoft-edge-dev-bin-131.0.2863.0-1-x86_64.pkg.tar.zst.sig to /app/persistence/box/pool//overlay//microsoft-edge-dev-bin-131.0.2863.0-1-x86_64.pkg.tar.zst.sig
production-1  | [2024-10-06 08:36:50.495029][trace]: User  commited a transaction: 0 packages added, 0 packages deleted
production-1  | [2024-10-06 08:36:52.630216][debug]: Pool: Moving file from /tmp/bxt/teamviewer-15.55.3-1-x86_64.pkg.tar.zst to /app/persistence/box/pool/overlay/teamviewer-15.55.3-1-x86_64.pkg.tar.zst
production-1  | [2024-10-06 08:36:52.630253][debug]: Pool: Adding new link count for /app/persistence/box/pool/overlay/teamviewer-15.55.3-1-x86_64.pkg.tar.zst
production-1  | [2024-10-06 08:36:52.630306][debug]: Pool: Moving signature file from /tmp/bxt//teamviewer-15.55.3-1-x86_64.pkg.tar.zst.sig to /app/persistence/box/pool//overlay//teamviewer-15.55.3-1-x86_64.pkg.tar.zst.sig
production-1  | [2024-10-06 08:36:52.634303][trace]: User  commited a transaction: 0 packages added, 0 packages deleted
production-1  | [2024-10-06 08:36:52.921274][info]: Exporter: "testing/extra/x86_64" export into the package manager format started
production-1  | [2024-10-06 08:36:52.934673][info]: Exporter: "testing/extra/x86_64" export finished
production-1  | [2024-10-06 08:36:54.768399][debug]: Pool: Moving file from /tmp/bxt/postman-bin-11.14.0-1-x86_64.pkg.tar.zst to /app/persistence/box/pool/overlay/postman-bin-11.14.0-1-x86_64.pkg.tar.zst
production-1  | [2024-10-06 08:36:54.768442][debug]: Pool: Adding new link count for /app/persistence/box/pool/overlay/postman-bin-11.14.0-1-x86_64.pkg.tar.zst
production-1  | [2024-10-06 08:36:54.768506][debug]: Pool: Moving signature file from /tmp/bxt//postman-bin-11.14.0-1-x86_64.pkg.tar.zst.sig to /app/persistence/box/pool//overlay//postman-bin-11.14.0-1-x86_64.pkg.tar.zst.sig
production-1  | [2024-10-06 08:36:54.786271][trace]: User  commited a transaction: 0 packages added, 0 packages deleted
production-1  | [2024-10-06 08:36:56.690102][debug]: Pool: Moving file from /tmp/bxt/visual-studio-code-bin-1.94.0-1-x86_64.pkg.tar.zst to /app/persistence/box/pool/overlay/visual-studio-code-bin-1.94.0-1-x86_64.pkg.tar.zst
production-1  | [2024-10-06 08:36:56.690136][debug]: Pool: Adding new link count for /app/persistence/box/pool/overlay/visual-studio-code-bin-1.94.0-1-x86_64.pkg.tar.zst
production-1  | [2024-10-06 08:36:56.690186][debug]: Pool: Moving signature file from /tmp/bxt//visual-studio-code-bin-1.94.0-1-x86_64.pkg.tar.zst.sig to /app/persistence/box/pool//overlay//visual-studio-code-bin-1.94.0-1-x86_64.pkg.tar.zst.sig
production-1  | [2024-10-06 08:36:56.705142][trace]: User  commited a transaction: 0 packages added, 0 packages deleted
production-1  | [2024-10-06 08:36:58.147637][debug]: Pool: Moving file from /tmp/bxt/proton-mail-1.0.6-1-x86_64.pkg.tar.zst to /app/persistence/box/pool/overlay/proton-mail-1.0.6-1-x86_64.pkg.tar.zst
production-1  | [2024-10-06 08:36:58.147673][debug]: Pool: Adding new link count for /app/persistence/box/pool/overlay/proton-mail-1.0.6-1-x86_64.pkg.tar.zst
production-1  | [2024-10-06 08:36:58.147730][debug]: Pool: Moving signature file from /tmp/bxt//proton-mail-1.0.6-1-x86_64.pkg.tar.zst.sig to /app/persistence/box/pool//overlay//proton-mail-1.0.6-1-x86_64.pkg.tar.zst.sig
production-1  | [2024-10-06 08:36:58.160345][trace]: User  commited a transaction: 0 packages added, 0 packages deleted
production-1  | [2024-10-06 08:36:58.854695][debug]: Pool: Moving file from /tmp/bxt/nordvpn-bin-3.19.0-2-x86_64.pkg.tar.zst to /app/persistence/box/pool/overlay/nordvpn-bin-3.19.0-2-x86_64.pkg.tar.zst
production-1  | [2024-10-06 08:36:58.854727][debug]: Pool: Adding new link count for /app/persistence/box/pool/overlay/nordvpn-bin-3.19.0-2-x86_64.pkg.tar.zst
production-1  | [2024-10-06 08:36:58.854770][debug]: Pool: Moving signature file from /tmp/bxt//nordvpn-bin-3.19.0-2-x86_64.pkg.tar.zst.sig to /app/persistence/box/pool//overlay//nordvpn-bin-3.19.0-2-x86_64.pkg.tar.zst.sig
production-1  | [2024-10-06 08:36:58.870219][trace]: User  commited a transaction: 0 packages added, 0 packages deleted
production-1  | [2024-10-06 08:36:59.455655][debug]: Pool: Moving file from /tmp/bxt/lib32-vulkan-amdgpu-pro-24.10_1787253-1-x86_64.pkg.tar.zst to /app/persistence/box/pool/overlay/lib32-vulkan-amdgpu-pro-24.10_1787253-1-x86_64.pkg.tar.zst
production-1  | [2024-10-06 08:36:59.455690][debug]: Pool: Adding new link count for /app/persistence/box/pool/overlay/lib32-vulkan-amdgpu-pro-24.10_1787253-1-x86_64.pkg.tar.zst
production-1  | [2024-10-06 08:36:59.455732][debug]: Pool: Moving signature file from /tmp/bxt//lib32-vulkan-amdgpu-pro-24.10_1787253-1-x86_64.pkg.tar.zst.sig to /app/persistence/box/pool//overlay//lib32-vulkan-amdgpu-pro-24.10_1787253-1-x86_64.pkg.tar.zst.sig
production-1  | [2024-10-06 08:36:59.471301][trace]: User  commited a transaction: 0 packages added, 0 packages deleted
production-1  | [2024-10-06 08:36:59.921468][info]: Exporter: "testing/extra/x86_64" export into the package manager format started

The file sizes

-rw-r--r-- 1 fh fh 243M  6 okt 08:50 azuredatastudio-bin-1.49.1-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh 221M  6 okt 08:51 microsoft-edge-dev-bin-131.0.2863.0-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh 144M 27 jul 14:25 teamviewer-15.55.3-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh 132M  6 okt 08:50 postman-bin-11.14.0-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh 125M  6 okt 09:10 visual-studio-code-bin-1.94.0-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh  94M  6 okt 08:59 proton-mail-1.0.6-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh  42M  6 okt 08:52 nordvpn-bin-3.19.0-2-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh  34M 10 aug 09:45 lib32-vulkan-amdgpu-pro-24.10_1787253-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 fh fh  32M 10 aug 09:45 vulkan-amdgpu-pro-24.10_1787253-1-x86_64.pkg.tar.zst

It does not appear to be related to file sizes - the hung file is only 32M ...

The console daemon log does indicate that Exporter might have something to do with it - but that is just an unqualified guess...

fhdk commented 1 month ago

I have to do

^CGracefully stopping... (press Ctrl+C again to force)
[+] Stopping 1/1
 ✔ Container bxt-production-1  Stopped                                                                                                                                                                                                                             10.3s 
canceled

10:46:31 ± [fh@tiger] .../manjaro-bxt/bxt
[master] $

which is registered with bxtctl

Error: 0. Message: {'Unexpected Response': ConnectionError(ProtocolError('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')))}