UniFi OS - Dream Machines 2.x

StiviiK commented 2 years ago

Ubiquiti recently annouced in the latest update notes for the UniFi OS - Dream Machines, they will migrate to 2.x soon. https://community.ui.com/releases/UniFi-OS-Dream-Machines-1-12-30/a4f85653-7bc6-461a-8715-94298cb69164

If I am not mistaken, that means they will align the firmware with the firmware of the UDM SE. Do you know what are the effects of that and how the work of this awesome project will be affected? I am only aware that this will drop Podman?

drpoutine commented 1 year ago

installed podman on 2.4.27 using the udmpro podman for the UDM base. for some reason it was defaulting to the udm se version for the udm base. went with udmpro since they share the same cpu (udm-base and udmp)

installed using the latest script for on_boot (1.0.6 at the time of this writing) podman installed as expected on udm base once udmpro zip was specified from https://unifi.boostchicken.io/ got my wpa_supplicant up and running in no time :)

tl:dr -

it works on v1.0.6 but podman script is wonky had to specify udmpro zip on the udm base (egg unit)

dvcrn commented 1 year ago

Went through the upgrade rodeo today on a normal UDM (not SE)

Podman from this repository didn't work, the blueberry version did. My other things look to be working fine so far (had to update /mnt/data to /data and CNI plugins script). Even the ansible scripts that I used to provision my UDM 1.x mostly worked without bigger changes.

Will monitor and report back!

dvcrn commented 1 year ago

I am running into some weird podman (blueberry version) issues (may be configuration related, but wanted to share anyway).

After reboot, some containers (like homebridge) go into a state where podman reports them running:

podman ps
CONTAINER ID  IMAGE                             COMMAND     CREATED         STATUS            PORTS       NAMES
6240527c1fe9  docker.io/oznu/homebridge:latest              22 minutes ago  Up 7 minutes ago              homebridge

When I check the logs it seems like nothing is happening and they're just frozen, but when I try to exec into them:

podman exec -it homebridge sh
Error: OCI runtime error: runc: exec failed: cannot exec in a stopped container

podman restart homebridge
ERRO[0000] cannot start a container that has stopped
Error: `/usr/bin/runc start 6240527c1fe9eca0b1b50c79394bd68facbb2d175155dc65d9eca14f7283fcb7` failed: exit status 1

podman start homebridge

Error: unable to start container "6240527c1fe9eca0b1b50c79394bd68facbb2d175155dc65d9eca14f7283fcb7": container 6240527c1fe9eca0b1b50c79394bd68facbb2d175155dc65d9eca14f7283fcb7 must be in Created or Stopped state to be started: container state improper

Basically the container is reported as running, but completely unresponsive. If I recreate the container everything is good again, until UDM restarts.

Anyone noticing something similar?

/EDIT: I removed the blueberry version and installed the one from this repository, but forced udmpro instead of the default for my normal UDM. This version actually works so I think we need to update the podman script to select the udmpro variant instead

waffles0042 commented 1 year ago

@waffles0042 did you try https://github.com/unifi-blueberry/addon-podman as mentioned above? I just tried that address and was able to access it:

Thank you very much @pedropombeiro ; no I had not seen it. With that I was able to get podman to work. I also got the last part done: pihole is running again. Looks I am back in business again! Thanks much!

PiHole has been running fine since my UDMP upgrade to 2.x some 2 weeks ago. However, when I tried upgrading to the latest PiHole version by pulling the latest PiHole image I kept getting this warning "WARN[0000] Failed to read current user namespace mappings". PiHole still upgraded fine, but I am wondering how I could rid of the warning. Any help would be greatly appreciated!

pedropombeiro commented 1 year ago

PiHole has been running fine since my UDMP upgrade to 2.x some 2 weeks ago. However, when I tried upgrading to the latest PiHole version by pulling the latest PiHole image I kept getting this warning "WARN[0000] Failed to read current user namespace mappings". PiHole still upgraded fine, but I am wondering how I could rid of the warning. Any help would be greatly appreciated!

A little search for the warning yielded this, seeming to point that the warning is harmless:

https://pullanswer.com/questions/podman-4-3-issues-udm-se-2-5-11#28034155

waffles0042 commented 1 year ago

PiHole has been running fine since my UDMP upgrade to 2.x some 2 weeks ago. However, when I tried upgrading to the latest PiHole version by pulling the latest PiHole image I kept getting this warning "WARN[0000] Failed to read current user namespace mappings". PiHole still upgraded fine, but I am wondering how I could rid of the warning. Any help would be greatly appreciated!

A little search for the warning yielded this, seeming to point that the warning is harmless:

https://pullanswer.com/questions/podman-4-3-issues-udm-se-2-5-11#28034155

Thank you for your comment and the link. Thus far, I have not experienced any issues and all seems to be working for me. I am just not used to seeing this warning when upgrading my pihole container.

ghost commented 1 year ago

I assume with Blueberry Podman DEB or the UDM-Boot 1.0.7, the DEB files can be installed with "dpkg -i" offline and doing so should recreate the on_boot.d directory...? Are there any other steps after running "dpkg -i"?

With firmware 1.X the DEB file had to be placed into UniFi-OS Shell directory and "dpkg -i" had to be performed from UniFi-OS Shell as well. In firmware 2.X, UniFi-OS Shell was removed. With UniFi-OS Shell removed, to where do I copy Blueberry Podman DEB or UDM-Boot 1.0.7 DEB files and from where do I run "dpkg -i" ? I need to perform the whole procedure offline.

emlynmac commented 1 year ago

I just got the 2.x onto my UDMP today and am looking at putting back all the config I had (pi-hole, LE cert, fan silence DDNS) One of the things I'm looking at is that the script to install puts to /data for the 2.x release, rather than /persistent (which seems to be the persistent 2G of storage. Should I install there - i.e. modify the install script?

ghost commented 1 year ago

I think it has something to do with this (last 3 bottom posts) - https://github.com/unifi-utilities/unifios-utilities/issues/472 .

Let us know how it goes. I am eager to jump to 2.4.7, but I want to make sure UDM-Boot is fully functional and doesn't have bugs installation bugs or other reported bugs.

emlynmac commented 1 year ago

I have just updated to 2.x. I moved my pi-hole off to a VM for the upgrade to make sure nothing broke too hard. After reviewing the updated remote install script, I modified the directory to point to /persistent instead of /data (this line: https://github.com/unifi-utilities/unifios-utilities/blob/main/on-boot-script/remote_install.sh#L10)

I ran the installer script and all seemed to go well. I then installed the unify-blueberry 0.2.0 release of pod man and created the cloudflare-ddns updater and the pihole-dote container.

I needed to update some paths in the 05-install-cni-plugins.sh (change/mnt/data to /persistent) to make it work I also needed to update udm-le with the new certificate paths; PR submitted to that repository.

It looks like the .deb on boot package is not required now? Just the systemd scripts? Is that the case?

And the fan control under 2.x is done without a boot script; apt install fan control and configure.

A relatively painless update? It's nice to have rsync on the UDMP at last!

ghost commented 1 year ago

Why have it in /persistent is important? Does it not persist if in /data directory?

dvcrn commented 1 year ago

Why have it in /persistent is important? Does it not persist if in /data directory?

it does, /data is persisted between boot

WolfspiritM commented 1 year ago

I just got "auto updated" last night and now my pihole is gone including podman. It seems like the previous data directory is gone where the config for the docker containers was stored. Is there any way to get it back?

StiviiK commented 1 year ago

I just got "auto updated" last night and now my pihole is gone including podman.

It seems like the previous data directory is gone where the config for the docker containers was stored.

Is there any way to get it back?

Unfortunately no. Ubiquiti explicitly mentioned multiple times that all custom data will be gone after the upgrade / migration. Tip, never let you UniFi OS console update automatically. I would recommend to always trigger an update manually. (And check beforehand the update notes.)

pedropombeiro commented 1 year ago

I'm coming across a few issues after having upgraded to 2.4.27, with some paths not existing. For instance:

/etc/containers/libpod.conf referenced by 05-container-common.sh does not exist on my UDM Pro, so this script fails at startup.
Same thing for /etc/init.d/crond in 25-add-cron-jobs.sh.
podman is also really slow to pull/create containers, compared with 1.x.

Anyone else seeing this?

UPDATE: I went through each script to try to figure out what is happening, and for instance for crond I replaced it with cron. I have Pi-hole running again, although I lost its configuration and my latest backup is a bit too old. But at least I'm now on 2.4 with a working system and will be able to fix the remaining issues with time.

emlynmac commented 1 year ago

Why have it in /persistent is important? Does it not persist if in /data directory?

it does, /data is persisted between boot

From reading https://github.com/unifi-utilities/unifios-utilities/issues/416#issuecomment-1401781585, it would seem that the new unifi-os has a specific persistent partition for things that should not be removed, say during software upgrades. I would prefer to keep all my custom config there, so as to try and minimize the breaks. Of course, this might be wiped too; but I think this /persistent area is supposed to be more persistent than the rest of the filesystem.

emlynmac commented 1 year ago

/etc/containers/libpod.conf referenced by 05-container-common.sh does not exist on my UDM Pro, so this script fails at startup.

@pedropombeiro The /etc/containers/containers.conf has the log size config; this now seems a sensible default. In my install, I just removed the 05-container-common.sh script.

pedropombeiro commented 1 year ago

Another thing that changed is the target location for firewall logs. They used to go to /var/log/messages, but now they go to /var/log/ulog/syslogemu.log.

ghost commented 1 year ago

There are quite a few new things, but in relation to UDM-Boot, when I run "dpkg -i UDM-Boot.deb" command, on_boot.d directory doesn't spawn and I get this error: "Failed to restart udm-boot.service: Unit udm-boot.service has a bad unit file setting. See system logs and 'systemctl status udm-boot.service' for details."

I don't get the same issue when I run the following commands that do spawn on_boot.d directory: curl -fsL "https://raw.githubusercontent.com/unifi-utilities/unifios-utilities/HEAD/on-boot-script/remote_install.sh" | /bin/sh curl -L https://unifi.boostchicken.io/udm-boot_1.0.7_all.deb -o udm-boot_1.0.7_all.deb dpkg -i udm-boot_1.0.7_all.deb systemctl enable udm-boot"

Any way to package the whole thing into one DEB file to make on_boot.d work from offline commands that don't download anything???

Where is SSH key store user private keys now? UDM now supports ED25519 keys. The script to persistant SSH key needs to be updated with whichever new directories that contain user private keys.

pedropombeiro commented 1 year ago

UDM now supports ED25519 keys.

@GY8VSdYYzvL8-K6T where have you seen this? I have UniFi OS 2.4.27 and Network 7.3.83, and if I go to System/Advanced/Device Authentication, it only accepts public keys starting with ssh-rsa. It does not accept ones starting with ssh-ed25519 🤔

ghost commented 1 year ago

That's different from root SSH access that can be enabled in the same place where you see "Turn Off" and "Restart" and "Factory Reset". If you enable SSH there, the machine signature fingerprint is ED25519. That means it recognizes ED25519. You can also go to "/etc/ssh" and see that it has "ssh_host_ed25519_key" key pairs that earlier versions of UDM Base/Pro doesn't have.

The Device Authentication Public Keys method can still be limited to RSA, but the root login should now accept ED25519 based on my findings. I just don't know where the "authorized_keys" file for root is located.

ghost commented 1 year ago

I figured it out. You need to create "/root/.ssh" directory and within it create "authorized_keys" file. It does accept ED25519 keys that way.

adradr commented 1 year ago

Does anyone experienced issues with podman pull on this new image? It feels like stuck a lot of times, also throwing errors like the following:

Error: writing blob: adding layer with blob "sha256:8f60cbaebd1956c10fac9cfb418e3540822764a32ca75c84fab37f51d6a4ee91": error creating layer with ID "cdfdaf5ca65d47f0b8997b4e4029e1b5d98d46651112459240f6ec00b5270775": open /var/lib/containers/storage/vfs/dir/cdfdaf5ca65d47f0b8997b4e4029e1b5d98d46651112459240f6ec00b5270775/bin/bash: file exists

This has been thrown after several minutes of the pull process (while the image is relatively small. I am not sure how to debug this..If I rerun the pull command it will struck on another layer next time.

pedropombeiro commented 1 year ago

@adradr Mine is also much slower than before. Regarding the errors, I'd check for free space in the /mnt/.rwfs volume (mine is at 72%, running Pi-hole and a couple of other smaller Docker containers). You can use df -h in the SSH terminal to check that.

adradr commented 1 year ago

Does anyone experienced issues with podman pull on this new image? It feels like stuck a lot of times, also throwing errors like the following:
Error: writing blob: adding layer with blob "sha256:8f60cbaebd1956c10fac9cfb418e3540822764a32ca75c84fab37f51d6a4ee91": error creating layer with ID "cdfdaf5ca65d47f0b8997b4e4029e1b5d98d46651112459240f6ec00b5270775": open /var/lib/containers/storage/vfs/dir/cdfdaf5ca65d47f0b8997b4e4029e1b5d98d46651112459240f6ec00b5270775/bin/bash: file exists
This has been thrown after several minutes of the pull process (while the image is relatively small. I am not sure how to debug this..If I rerun the pull command it will struck on another layer next time.

I realized I am running out of space regularly, this may cause this as I guess it takes more time after it downloads and unpacks.

du -h var/lib/containers/storage/vfs/dir | sort -rh | head -50
7.7G    var/lib/containers/storage/vfs/dir
558M    var/lib/containers/storage/vfs/dir/cdfdaf5ca65d47f0b8997b4e4029e1b5d98d46651112459240f6ec00b5270775
558M    var/lib/containers/storage/vfs/dir/c4477b3d9e2471c3f6b6cef62c594a187192eba3ba655812a6607dcbbdb52885
558M    var/lib/containers/storage/vfs/dir/bf2c66849a48371d155758f9879ec6d3a8a70b830dd8d0b726b10a6effba84b8
458M    var/lib/containers/storage/vfs/dir/cdfdaf5ca65d47f0b8997b4e4029e1b5d98d46651112459240f6ec00b5270775/usr
458M    var/lib/containers/storage/vfs/dir/c4477b3d9e2471c3f6b6cef62c594a187192eba3ba655812a6607dcbbdb52885/usr
458M    var/lib/containers/storage/vfs/dir/bf2c66849a48371d155758f9879ec6d3a8a70b830dd8d0b726b10a6effba84b8/usr
348M    var/lib/containers/storage/vfs/dir/dfdc5c43aa32ed9a80c13ddbb82ba412ff26cb5195450697245e017c7b93ec5a
348M    var/lib/containers/storage/vfs/dir/520faad0dbc3b761f35aac1b6a4fb14a52b0cf8dd741befe0f25e77b2aa79364
348M    var/lib/containers/storage/vfs/dir/17901b3132741066229e4fc6bf7a6bd7fdfea2739f982624a43a8c29f321e646
326M    var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c
322M    var/lib/containers/storage/vfs/dir/e91301e27921bd5e8c8b8fc6cb270b27e4c3d884eb1364f29f847d76c10673bd
322M    var/lib/containers/storage/vfs/dir/713be83d1a358cc67c72886f38996210c7f5b058f5b46f5d4e17f650d2e94d05
322M    var/lib/containers/storage/vfs/dir/3225a77464ab369ff84b6967f60ae1118eb56d7e0e9fb06dd6e6a4940e14431a
273M    var/lib/containers/storage/vfs/dir/b7f0f96e44f53f3bf96f11b453f0256884536ecf3a076fb4096b247ef0eae637
273M    var/lib/containers/storage/vfs/dir/5167835fdf637c34ed1b38be543cfd940d678f6aa5e87b9aa2f6f4a668077fdf
248M    var/lib/containers/storage/vfs/dir/c2bd9a05e1df39428e99ddcfe16c36ec4789392eb024b0ad5d021b41bc8e508a
244M    var/lib/containers/storage/vfs/dir/e7332d099c1a06021c5b962992a8582a90fb734ff5c565264c13c7fc327a2e35
244M    var/lib/containers/storage/vfs/dir/dc1e957a23f7539e6799f677b0f4064c7a235eddb9155dc8399c375427b6edb9
244M    var/lib/containers/storage/vfs/dir/53ea01349548a91dc3d83a7738a688c9820351c74493e94670180e6f5cb52794
244M    var/lib/containers/storage/vfs/dir/4fed4bd926fddb8d0479c1d854bf8ac5e251ae426df23cd2327c960b0837194b
244M    var/lib/containers/storage/vfs/dir/48a0e0d88953e8eff8498efeb528a6c84d7f1ab36ed4f5605f0f8c20bd0a5ba1
235M    var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr
235M    var/lib/containers/storage/vfs/dir/e91301e27921bd5e8c8b8fc6cb270b27e4c3d884eb1364f29f847d76c10673bd/usr
235M    var/lib/containers/storage/vfs/dir/713be83d1a358cc67c72886f38996210c7f5b058f5b46f5d4e17f650d2e94d05/usr
235M    var/lib/containers/storage/vfs/dir/3225a77464ab369ff84b6967f60ae1118eb56d7e0e9fb06dd6e6a4940e14431a/usr
225M    var/lib/containers/storage/vfs/dir/cdfdaf5ca65d47f0b8997b4e4029e1b5d98d46651112459240f6ec00b5270775/usr/lib
225M    var/lib/containers/storage/vfs/dir/c4477b3d9e2471c3f6b6cef62c594a187192eba3ba655812a6607dcbbdb52885/usr/lib
225M    var/lib/containers/storage/vfs/dir/bf2c66849a48371d155758f9879ec6d3a8a70b830dd8d0b726b10a6effba84b8/usr/lib
214M    var/lib/containers/storage/vfs/dir/e7332d099c1a06021c5b962992a8582a90fb734ff5c565264c13c7fc327a2e35/usr
214M    var/lib/containers/storage/vfs/dir/dc1e957a23f7539e6799f677b0f4064c7a235eddb9155dc8399c375427b6edb9/usr
214M    var/lib/containers/storage/vfs/dir/53ea01349548a91dc3d83a7738a688c9820351c74493e94670180e6f5cb52794/usr
214M    var/lib/containers/storage/vfs/dir/4fed4bd926fddb8d0479c1d854bf8ac5e251ae426df23cd2327c960b0837194b/usr
214M    var/lib/containers/storage/vfs/dir/48a0e0d88953e8eff8498efeb528a6c84d7f1ab36ed4f5605f0f8c20bd0a5ba1/usr
203M    var/lib/containers/storage/vfs/dir/dd9e5b0fbdb2e827bc5d43fabf1b83f80f31e5ffa35aa145e3f80d33a4a4cb94
203M    var/lib/containers/storage/vfs/dir/5a00e8151a01d969f19f45d2a88b9150ba8bbdb810a09a6529493df356834d92
178M    var/lib/containers/storage/vfs/dir/dfdc5c43aa32ed9a80c13ddbb82ba412ff26cb5195450697245e017c7b93ec5a/tmp
178M    var/lib/containers/storage/vfs/dir/b7f0f96e44f53f3bf96f11b453f0256884536ecf3a076fb4096b247ef0eae637/usr
178M    var/lib/containers/storage/vfs/dir/520faad0dbc3b761f35aac1b6a4fb14a52b0cf8dd741befe0f25e77b2aa79364/tmp
178M    var/lib/containers/storage/vfs/dir/5167835fdf637c34ed1b38be543cfd940d678f6aa5e87b9aa2f6f4a668077fdf/usr
178M    var/lib/containers/storage/vfs/dir/17901b3132741066229e4fc6bf7a6bd7fdfea2739f982624a43a8c29f321e646/tmp
175M    var/lib/containers/storage/vfs/dir/a2a755c9fe4e76a4de40b7ce5a60a1e3dfadbc61591304fb662a569a19d44a05
175M    var/lib/containers/storage/vfs/dir/3edb4cf7d3ab9ef4dd747aec6b838a0b523a7d12df93fc2c3e683fa4fd43ef83
174M    var/lib/containers/storage/vfs/dir/dfdc5c43aa32ed9a80c13ddbb82ba412ff26cb5195450697245e017c7b93ec5a/tmp/openresty
174M    var/lib/containers/storage/vfs/dir/520faad0dbc3b761f35aac1b6a4fb14a52b0cf8dd741befe0f25e77b2aa79364/tmp/openresty
174M    var/lib/containers/storage/vfs/dir/17901b3132741066229e4fc6bf7a6bd7fdfea2739f982624a43a8c29f321e646/tmp/openresty
173M    var/lib/containers/storage/vfs/dir/768a8fa550669457265dac388e1d8780a421a1d7f0d2ced1a3a18d0a900e0b7e
173M    var/lib/containers/storage/vfs/dir/739c028509638f32f8867f82ccbaca554ca3495546c8df562b3ae1f1e4be1a41
173M    var/lib/containers/storage/vfs/dir/06448847114b3176a050c39f95fa0acbacd92aa0bd15702b77e129f3bdafc3e5
171M    var/lib/containers/storage/vfs/dir/e6494cc329aa71fa31f2402a5860168ffab861762392d14b1eef87f08e0504f2

I am not really what are these containers. I woke up today that my UDM Pro auto-updated to 2.4.27 and my pihole and proxymanager disappeared. I am still in the process of understanding what this update brought in terms of changes.

I am reconfiguring my previous setup, and only have pihole running yet, so unsure about these containers in /mnt/.rwfs/data/var/lib/.

podman ps
CONTAINER ID  IMAGE                           COMMAND     CREATED      STATUS          PORTS       NAMES
fae3f45f1245  docker.io/pihole/pihole:latest              2 hours ago  Up 2 hours ago              pihole

pedropombeiro commented 1 year ago

I'd do a podman system prune -a to clean up all Docker state and recover that disk space.

emlynmac commented 1 year ago

Maybe also move the podman container storage area out to your hard-drive partition? /etc/containers/storage.conf configures.

pedropombeiro commented 1 year ago

@emlynmac the /persistent partition

Maybe also move the podman container storage area out to your hard-drive partition? /etc/containers/storage.conf configures.

@emlynmac That's a good idea. Do I need to write a on_boot.d script to make that change on every boot?

pedropombeiro commented 1 year ago

Can someone who is not using podman (or has moved its storage to the hard-drive) please confirm that the /var/lib/containers/storage path is empty? I stopped all containers and pruned the docker system, but there are still 3.6G laying there:

$ du -h -d 1 /var/lib/containers/storage
3.6G    /var/lib/containers/storage/vfs
156K    /var/lib/containers/storage/libpod
1.7M    /var/lib/containers/storage/vfs-layers
4.0K    /var/lib/containers/storage/tmp
4.0K    /var/lib/containers/storage/mounts
92K /var/lib/containers/storage/vfs-containers
60K /var/lib/containers/storage/vfs-images
4.0K    /var/lib/containers/storage/secrets
3.6G    /var/lib/containers/storage

emlynmac commented 1 year ago

@emlynmac the /persistent partition

Maybe also move the podman container storage area out to your hard-drive partition? /etc/containers/storage.conf configures.

@emlynmac That's a good idea. Do I need to write a on_boot.d script to make that change on every boot? @pedropombeiro I edited to the hard drive parition as the /persistent is capped at 2G. Either would work I think, just moves it off the root fs.

I would think that the configuration is persisted, and installed with the initial version with whatever comes with the Podman .deb package.

pedropombeiro commented 1 year ago

I'm a bit concerned by the 2.4.27 release, in terms of CPU usage:

Before the update, the CPU usage hovered around 20% for weeks in a very stable manner, but now there are periods where the java process just goes into overdrive :-/

emlynmac commented 1 year ago

@pedropombeiro what tool are you getting those nice graphics from?

pedropombeiro commented 1 year ago

@pedropombeiro what tool are you getting those nice graphics from?

I have the node-exporter Docker container running on the UDM Pro, and then I have a Grafana server running on my NAS pulling the stats, with the stock node-exporter dashboard.

adradr commented 1 year ago

I'd do a podman system prune -a to clean up all Docker state and recover that disk space.

I did a pruning but it was able to prune 0B of space. Still don't understand what occupies that much space since I only have one pihole running.

df -h
Filesystem                         Size  Used Avail Use% Mounted on
udev                               2.0G     0  2.0G   0% /dev
tmpfs                              395M   31M  365M   8% /run
/dev/disk/by-partlabel/root        2.0G  839M  996M  46% /boot/firmware
/dev/loop0                         833M  833M     0 100% /mnt/.rofs
/dev/disk/by-partlabel/overlay     9.3G  9.2G     0 100% /mnt/.rwfs
overlayfs-root                     9.3G  9.2G     0 100% /
/dev/disk/by-partlabel/log         976M   73M  837M   8% /var/log
/dev/disk/by-partlabel/persistent  2.0G   11M  1.8G   1% /persistent
tmpfs                              2.0G  104K  2.0G   1% /dev/shm
tmpfs                              5.0M     0  5.0M   0% /run/lock
tmpfs                              2.0G     0  2.0G   0% /sys/fs/cgroup
tmpfs                              987M   72K  987M   1% /tmp
tmpfs                               16M  9.7M  6.4M  61% /var/log/ulog
shm                                 63M  2.9M   60M   5% /var/lib/containers/storage/vfs-containers/fae3f45f124598ea127b9871209b9ca45640469183b2525d26f8d7b4277490ca/userdata/shm
tmpfs                               64M 1020K   64M   2% /var/opt/unifi/tmp

pedropombeiro commented 1 year ago

@adradr did you try delving into /mnt/.rwfs with du -h -d 1 /mnt/.rwfs and proceeding downwards to pinpoint what is causing the 100% usage?

pedropombeiro commented 1 year ago

For future reference, confirmed that the changes to /etc/containers/storage.conf persist with reboots:

$ docker info
...
store:
  configFile: /etc/containers/storage.conf
  containerStore:
    number: 4
    paused: 0
    running: 4
    stopped: 0
  graphDriverName: vfs
  graphOptions: {}
  graphRoot: /volume1/var/lib/containers/storage
  graphRootAllocated: 117610516480
  graphRootUsed: 47095312384
  graphStatus: {}
  imageCopyTmpDir: /var/tmp
  imageStore:
    number: 4
  runRoot: /volume1/run/containers/storage
  volumePath: /volume1/var/lib/containers/storage/volumes
...

pedropombeiro commented 1 year ago

Checked which processes were using any of the files under /var/lib/containers

lsof +D /var/lib/containers

and deleted it given no processes had any files open there, saving a further 3.6GB:

My /mnt/.rwfs volume is now only 21%:

$ df -h
Filesystem                         Size  Used Avail Use% Mounted on
udev                               2.0G     0  2.0G   0% /dev
tmpfs                              395M   41M  355M  11% /run
/dev/disk/by-partlabel/root        2.0G  839M  996M  46% /boot/firmware
/dev/loop0                         833M  833M     0 100% /mnt/.rofs
/dev/disk/by-partlabel/overlay     9.3G  1.8G  7.0G  21% /mnt/.rwfs
overlayfs-root                     9.3G  1.8G  7.0G  21% /
/dev/disk/by-partlabel/log         976M  129M  781M  15% /var/log
/dev/disk/by-partlabel/persistent  2.0G  259M  1.6G  15% /persistent
tmpfs                              2.0G  108K  2.0G   1% /dev/shm
tmpfs                              5.0M     0  5.0M   0% /run/lock
tmpfs                              2.0G     0  2.0G   0% /sys/fs/cgroup
tmpfs                              987M   72K  987M   1% /tmp
/dev/sda1                          110G   44G   65G  41% /volume1
tmpfs                               16M  844K   16M   6% /var/log/ulog
shm                                 63M  7.4M   56M  12% /volume1/var/lib/containers/storage/vfs-containers/83157258d55cec3d5091d9d407116aae1bea073750335826f805418b1c2bafa3/userdata/shm
shm                                 63M     0   63M   0% /volume1/var/lib/containers/storage/vfs-containers/0d8851a757fcb1ba2fbd364b0a95bb6dd1634117fac1c2416eefc2adebdaef94/userdata/shm
shm                                 63M     0   63M   0% /volume1/var/lib/containers/storage/vfs-containers/bad5d869bfa1c46dfa95768dd28cb4f65054142db92e1d4ed12f39ab5e6b46e4/userdata/shm
shm                                 63M     0   63M   0% /volume1/var/lib/containers/storage/vfs-containers/d1982d622961729964126ad7e704c13bbc0f393989fbb0ca58de8564c7d4bdc5/userdata/shm
tmpfs                               64M     0   64M   0% /var/opt/unifi/tmp
tmpfs                              512M  4.1M  508M   1% /var/opt/unifi-protect/tmp

adradr commented 1 year ago

Checked which processes were using any of the files under /var/lib/containers

lsof +D /var/lib/containers

and deleted it given no processes had any files open there, saving a further 3.6GB:

My /mnt/.rwfs volume is now only 21%:

$ df -h
Filesystem                         Size  Used Avail Use% Mounted on
udev                               2.0G     0  2.0G   0% /dev
tmpfs                              395M   41M  355M  11% /run
/dev/disk/by-partlabel/root        2.0G  839M  996M  46% /boot/firmware
/dev/loop0                         833M  833M     0 100% /mnt/.rofs
/dev/disk/by-partlabel/overlay     9.3G  1.8G  7.0G  21% /mnt/.rwfs
overlayfs-root                     9.3G  1.8G  7.0G  21% /
/dev/disk/by-partlabel/log         976M  129M  781M  15% /var/log
/dev/disk/by-partlabel/persistent  2.0G  259M  1.6G  15% /persistent
tmpfs                              2.0G  108K  2.0G   1% /dev/shm
tmpfs                              5.0M     0  5.0M   0% /run/lock
tmpfs                              2.0G     0  2.0G   0% /sys/fs/cgroup
tmpfs                              987M   72K  987M   1% /tmp
/dev/sda1                          110G   44G   65G  41% /volume1
tmpfs                               16M  844K   16M   6% /var/log/ulog
shm                                 63M  7.4M   56M  12% /volume1/var/lib/containers/storage/vfs-containers/83157258d55cec3d5091d9d407116aae1bea073750335826f805418b1c2bafa3/userdata/shm
shm                                 63M     0   63M   0% /volume1/var/lib/containers/storage/vfs-containers/0d8851a757fcb1ba2fbd364b0a95bb6dd1634117fac1c2416eefc2adebdaef94/userdata/shm
shm                                 63M     0   63M   0% /volume1/var/lib/containers/storage/vfs-containers/bad5d869bfa1c46dfa95768dd28cb4f65054142db92e1d4ed12f39ab5e6b46e4/userdata/shm
shm                                 63M     0   63M   0% /volume1/var/lib/containers/storage/vfs-containers/d1982d622961729964126ad7e704c13bbc0f393989fbb0ca58de8564c7d4bdc5/userdata/shm
tmpfs                               64M     0   64M   0% /var/opt/unifi/tmp
tmpfs                              512M  4.1M  508M   1% /var/opt/unifi-protect/tmp

I did an lsof also and I noticed my currently running container only uses a small portion of the files under /mnt/.rwfs/..

podman ps
CONTAINER ID  IMAGE                           COMMAND     CREATED      STATUS          PORTS       NAMES
fae3f45f1245  docker.io/pihole/pihole:latest              8 hours ago  Up 5 hours ago              pihole

Based on this this is my container id fae3f45f1245 and if you take a look at the lsof output only the first 5 entries are related to my running container:

lsof +D /mnt/.rwfs/data/var/lib/containers
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
COMMAND     PID     USER   FD   TYPE DEVICE SIZE/OFF   NODE NAME
conmon     2419     root    6w   REG  135,6    40110 404873 /mnt/.rwfs/data/var/lib/containers/storage/vfs-containers/fae3f45f124598ea127b9871209b9ca45640469183b2525d26f8d7b4277490ca/userdata/ctr.log
conmon     2419     root   12r  FIFO  135,6      0t0 404886 /mnt/.rwfs/data/var/lib/containers/storage/vfs-containers/fae3f45f124598ea127b9871209b9ca45640469183b2525d26f8d7b4277490ca/userdata/ctl
conmon     2419     root   14w  FIFO  135,6      0t0 404886 /mnt/.rwfs/data/var/lib/containers/storage/vfs-containers/fae3f45f124598ea127b9871209b9ca45640469183b2525d26f8d7b4277490ca/userdata/ctl
conmon     2419     root   15r  FIFO  135,6      0t0 404887 /mnt/.rwfs/data/var/lib/containers/storage/vfs-containers/fae3f45f124598ea127b9871209b9ca45640469183b2525d26f8d7b4277490ca/userdata/winsz
conmon     2419     root   16w  FIFO  135,6      0t0 404887 /mnt/.rwfs/data/var/lib/containers/storage/vfs-containers/fae3f45f124598ea127b9871209b9ca45640469183b2525d26f8d7b4277490ca/userdata/winsz
s6-svscan  2481     root  txt    REG  135,6    42168 547424 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/package/admin/s6-2.11.1.2/command/s6-svscan
s6-svscan  2481     root    3w   REG  135,6        0 549533 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/service/.s6-svscan/lock
s6-svscan  2481     root    5r  FIFO  135,6      0t0 549534 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/service/.s6-svscan/control
s6-svscan  2481     root    6w  FIFO  135,6      0t0 549534 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/service/.s6-svscan/control
s6-superv  2581     root  txt    REG  135,6    50408 547415 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/package/admin/s6-2.11.1.2/command/s6-supervise
s6-superv  2581     root    3w   REG  135,6        0 549535 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/service/s6-linux-init-shutdownd/supervise/lock
s6-superv  2581     root    4r  FIFO  135,6      0t0 549536 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/service/s6-linux-init-shutdownd/supervise/control
s6-superv  2581     root    5w  FIFO  135,6      0t0 549536 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/service/s6-linux-init-shutdownd/supervise/control
s6-linux-  2583     root  txt    REG  135,6    42152 547445 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/package/admin/s6-linux-init-1.0.8.0/command/s6-linux-init-shutdownd
s6-linux-  2583     root    3r  FIFO  135,6      0t0 549532 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/service/s6-linux-init-shutdownd/fifo
s6-linux-  2583     root    4w  FIFO  135,6      0t0 549532 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/service/s6-linux-init-shutdownd/fifo
s6-superv  2611     root  txt    REG  135,6    50408 547415 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/package/admin/s6-2.11.1.2/command/s6-supervise
s6-superv  2611     root    3w   REG  135,6        0 612298 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/s6rc-oneshot-runner/supervise/lock
s6-superv  2611     root    4r  FIFO  135,6      0t0 612299 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/s6rc-oneshot-runner/supervise/control
s6-superv  2611     root    5w  FIFO  135,6      0t0 612299 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/s6rc-oneshot-runner/supervise/control
s6-superv  2612     root  txt    REG  135,6    50408 547415 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/package/admin/s6-2.11.1.2/command/s6-supervise
s6-superv  2612     root    3w   REG  135,6        0 612284 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/cron/supervise/lock
s6-superv  2612     root    4r  FIFO  135,6      0t0 612290 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/cron/supervise/control
s6-superv  2612     root    5w  FIFO  135,6      0t0 612290 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/cron/supervise/control
s6-superv  2613     root  txt    REG  135,6    50408 547415 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/package/admin/s6-2.11.1.2/command/s6-supervise
s6-superv  2613     root    3w   REG  135,6        0 612287 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/pihole-FTL/supervise/lock
s6-superv  2613     root    4r  FIFO  135,6      0t0 612306 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/pihole-FTL/supervise/control
s6-superv  2613     root    5w  FIFO  135,6      0t0 612306 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/pihole-FTL/supervise/control
s6-superv  2614     root  txt    REG  135,6    50408 547415 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/package/admin/s6-2.11.1.2/command/s6-supervise
s6-superv  2614     root    3w   REG  135,6        0 612302 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/lighttpd-access-log/supervise/lock
s6-superv  2614     root    4r  FIFO  135,6      0t0 612303 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/lighttpd-access-log/supervise/control
s6-superv  2614     root    5w  FIFO  135,6      0t0 612303 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/lighttpd-access-log/supervise/control
s6-superv  2615     root  txt    REG  135,6    50408 547415 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/package/admin/s6-2.11.1.2/command/s6-supervise
s6-superv  2615     root    3w   REG  135,6        0 612296 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/s6rc-fdholder/supervise/lock
s6-superv  2615     root    4r  FIFO  135,6      0t0 612314 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/s6rc-fdholder/supervise/control
s6-superv  2615     root    5w  FIFO  135,6      0t0 612314 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/s6rc-fdholder/supervise/control
s6-superv  2616     root  txt    REG  135,6    50408 547415 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/package/admin/s6-2.11.1.2/command/s6-supervise
s6-superv  2616     root    3w   REG  135,6        0 612276 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/lighttpd/supervise/lock
s6-superv  2616     root    4r  FIFO  135,6      0t0 612313 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/lighttpd/supervise/control
s6-superv  2616     root    5w  FIFO  135,6      0t0 612313 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/lighttpd/supervise/control
s6-superv  2617     root  txt    REG  135,6    50408 547415 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/package/admin/s6-2.11.1.2/command/s6-supervise
s6-superv  2617     root    3w   REG  135,6        0 612308 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/lighttpd-error-log/supervise/lock
s6-superv  2617     root    4r  FIFO  135,6      0t0 612309 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/lighttpd-error-log/supervise/control
s6-superv  2617     root    5w  FIFO  135,6      0t0 612309 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/lighttpd-error-log/supervise/control
s6-ipcser  2626     root  txt    REG  135,6    29912 547402 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/package/admin/s6-2.11.1.2/command/s6-ipcserverd
bash       2651     root  txt    REG  135,6  1282512 545828 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/bin/bash
bash       2651     root  mem    REG  135,6          547120 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libnss_files-2.31.so (stat: No such file or directory)
bash       2651     root  mem    REG  135,6          547080 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libc-2.31.so (stat: No such file or directory)
bash       2651     root  mem    REG  135,6          547090 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libdl-2.31.so (stat: No such file or directory)
bash       2651     root  mem    REG  135,6          547150 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libtinfo.so.6.2 (stat: No such file or directory)
bash       2651     root  mem    REG  135,6          547068 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/ld-2.31.so (stat: No such file or directory)
bash       2651     root  255r   REG  135,6       69 612252 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/cron/run
cron       2659     root  txt    REG  135,6    51560 277778 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/sbin/cron
cron       2659     root  mem    REG  135,6          547120 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libnss_files-2.31.so (stat: No such file or directory)
cron       2659     root  mem    REG  135,6          547135 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libpthread-2.31.so (stat: No such file or directory)
cron       2659     root  mem    REG  135,6          547083 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libcap-ng.so.0.0.0 (path dev=0,19, inode=2258)
cron       2659     root  mem    REG  135,6          146633 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libpcre2-8.so.0.10.1 (stat: No such file or directory)
cron       2659     root  mem    REG  135,6          547090 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libdl-2.31.so (stat: No such file or directory)
cron       2659     root  mem    REG  135,6          547076 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libaudit.so.1.0.0 (path dev=0,19, inode=2247)
cron       2659     root  mem    REG  135,6          547080 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libc-2.31.so (stat: No such file or directory)
cron       2659     root  mem    REG  135,6          547143 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libselinux.so.1 (path dev=0,19, inode=2367)
cron       2659     root  mem    REG  135,6          547125 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libpam.so.0.85.1 (stat: No such file or directory)
cron       2659     root  mem    REG  135,6          547068 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/ld-2.31.so (stat: No such file or directory)
cron       2659     root    3u   REG  135,6        3 549549 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/crond.pid
bash       2844     root  txt    REG  135,6  1282512 545828 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/bin/bash
bash       2844     root  mem    REG  135,6          547120 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libnss_files-2.31.so (stat: No such file or directory)
bash       2844     root  mem    REG  135,6          547080 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libc-2.31.so (stat: No such file or directory)
bash       2844     root  mem    REG  135,6          547090 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libdl-2.31.so (stat: No such file or directory)
bash       2844     root  mem    REG  135,6          547150 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libtinfo.so.6.2 (stat: No such file or directory)
bash       2844     root  mem    REG  135,6          547068 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/ld-2.31.so (stat: No such file or directory)
bash       2844     root  255r   REG  135,6     2361 612254 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/pihole-FTL/run
bash       2851     root  txt    REG  135,6  1282512 545828 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/bin/bash
bash       2851     root  mem    REG  135,6          547120 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libnss_files-2.31.so (stat: No such file or directory)
bash       2851     root  mem    REG  135,6          547080 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libc-2.31.so (stat: No such file or directory)
bash       2851     root  mem    REG  135,6          547090 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libdl-2.31.so (stat: No such file or directory)
bash       2851     root  mem    REG  135,6          547150 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libtinfo.so.6.2 (stat: No such file or directory)
bash       2851     root  mem    REG  135,6          547068 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/ld-2.31.so (stat: No such file or directory)
bash       2851     root  255r   REG  135,6     1291 612270 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/lighttpd/run
lighttpd   2857 www-data  txt    REG  135,6   375208 277801 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/sbin/lighttpd
lighttpd   2857 www-data  mem    REG  135,6          547120 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libnss_files-2.31.so (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          147387 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/lighttpd/mod_staticfile.so (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          147368 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/lighttpd/mod_dirlisting.so (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          147373 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/lighttpd/mod_fastcgi.so (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          147362 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/lighttpd/mod_accesslog.so (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          147383 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/lighttpd/mod_setenv.so (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          147378 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/lighttpd/mod_redirect.so (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          147364 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/lighttpd/mod_alias.so (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          147361 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/lighttpd/mod_access.so (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          147375 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/lighttpd/mod_indexfile.so (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          547135 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libpthread-2.31.so (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          547080 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libc-2.31.so (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          146682 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libxxhash.so.0.8.0 (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          146618 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libnettle.so.8.4 (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          547090 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libdl-2.31.so (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          547132 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libpcre.so.3.13.3 (path dev=0,19, inode=2352)
lighttpd   2857 www-data  mem    REG  135,6          547068 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/ld-2.31.so (stat: No such file or directory)
lighttpd   2857 www-data    3w   REG  135,6        4 549564 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/lighttpd.pid
lighttpd   2857 www-data    5w   REG  135,6      941 532814 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/var/log/lighttpd/error-pihole.log
lighttpd   2857 www-data    6w   REG  135,6      358 549565 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/var/log/lighttpd/access.log
lighttpd   2857 www-data    7w   REG  135,6    37656 546492 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/var/log/lighttpd/access-pihole.log
lsof: no pwd entry for UID 999
bash       2870      999  txt    REG  135,6  1282512 545828 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/bin/bash
lsof: no pwd entry for UID 999
bash       2870      999  mem    REG  135,6          547120 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libnss_files-2.31.so (stat: No such file or directory)
lsof: no pwd entry for UID 999
bash       2870      999  mem    REG  135,6          547080 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libc-2.31.so (stat: No such file or directory)
lsof: no pwd entry for UID 999
bash       2870      999  mem    REG  135,6          547090 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libdl-2.31.so (stat: No such file or directory)
lsof: no pwd entry for UID 999
bash       2870      999  mem    REG  135,6          547150 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libtinfo.so.6.2 (stat: No such file or directory)
lsof: no pwd entry for UID 999
bash       2870      999  mem    REG  135,6          547068 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/ld-2.31.so (stat: No such file or directory)
lsof: no pwd entry for UID 999
pihole-FT  2873      999  txt    REG  135,6 20089760 547936 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/bin/pihole-FTL
lsof: no pwd entry for UID 999
pihole-FT  2873      999  mem    REG  135,6          547139 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libresolv-2.31.so (stat: No such file or directory)
lsof: no pwd entry for UID 999
pihole-FT  2873      999  mem    REG  135,6          547118 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libnss_dns-2.31.so (stat: No such file or directory)
lsof: no pwd entry for UID 999
pihole-FT  2873      999  mem    REG  135,6          146491 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/gconv/gconv-modules.cache (path dev=0,19, inode=5467)
lsof: no pwd entry for UID 999
pihole-FT  2873      999  mem    REG  135,6          547120 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libnss_files-2.31.so (stat: No such file or directory)
lsof: no pwd entry for UID 999
pihole-FT  2873      999  mem    REG  135,6          547080 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libc-2.31.so (stat: No such file or directory)
lsof: no pwd entry for UID 999
pihole-FT  2873      999  mem    REG  135,6          547135 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libpthread-2.31.so (stat: No such file or directory)
lsof: no pwd entry for UID 999
pihole-FT  2873      999  mem    REG  135,6          547141 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/librt-2.31.so (stat: No such file or directory)
lsof: no pwd entry for UID 999
pihole-FT  2873      999  mem    REG  135,6          547107 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libm-2.31.so (stat: No such file or directory)
lsof: no pwd entry for UID 999
pihole-FT  2873      999  mem    REG  135,6          547068 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/ld-2.31.so (stat: No such file or directory)
lsof: no pwd entry for UID 999
pihole-FT  2873      999   26w   REG  135,6 10977280 549553 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/var/log/pihole/pihole.log
php-cgi    2918 www-data  txt    REG  135,6  4598608 547932 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/bin/php-cgi7.4
php-cgi    2918 www-data  mem    REG  135,6          547100 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libgpg-error.so.0.29.0 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146553 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libgcrypt.so.20.2.8 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146543 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libexslt.so.0.8.20 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146678 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libxslt.so.1.1.34 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277704 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xsl.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277703 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xmlwriter.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277702 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xmlreader.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277700 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/tokenizer.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277699 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvshm.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277698 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvsem.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277697 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvmsg.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277696 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sqlite3.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277695 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sockets.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277694 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/simplexml.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277693 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/shmop.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146608 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libmd.so.0.0.4 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146524 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libbsd.so.0.11.3 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          547150 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libtinfo.so.6.2 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146537 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libedit.so.2.0.63 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277692 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/readline.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277691 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/posix.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277690 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/phar.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146655 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libsqlite3.so.0.8.6 (path dev=0,19, inode=5834)
php-cgi    2918 www-data  mem    REG  135,6          277689 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/pdo_sqlite.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277686 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/json.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146569 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicui18n.so.67.1 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146571 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicuio.so.67.1 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          267060 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/intl.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          267059 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/iconv.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          267058 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/gettext.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          267057 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ftp.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          267056 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/fileinfo.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146545 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libffi.so.7.1.0 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          267055 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ffi.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          267054 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/exif.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          267053 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/dom.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          267052 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ctype.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          267051 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/calendar.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277701 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xml.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277688 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/pdo.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          547141 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/librt-2.31.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277687 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/opcache.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          547098 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libgcc_s.so.1 (path dev=0,19, inode=2282)
php-cgi    2918 www-data  mem    REG  135,6          146660 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libstdc++.so.6.0.28 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146567 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicudata.so.67.1 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          547106 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/liblzma.so.5.2.5 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146577 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicuuc.so.67.1 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          547135 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libpthread-2.31.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          547080 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libc-2.31.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146653 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libsodium.so.23.3.0 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          547156 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libz.so.1.2.11 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146633 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libpcre2-8.so.0.10.1 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146525 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libcrypto.so.1.1 (path dev=0,19, inode=5546)
php-cgi    2918 www-data  mem    REG  135,6          146658 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libssl.so.1.1 (path dev=0,19, inode=5838)
php-cgi    2918 www-data  mem    REG  135,6          146676 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libxml2.so.2.9.10 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          547090 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libdl-2.31.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          547107 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libm-2.31.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          547139 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libresolv-2.31.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146509 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libargon2.so.1 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          547068 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/ld-2.31.so (stat: No such file or directory)
php-cgi    2962 www-data  txt    REG  135,6  4598608 547932 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/bin/php-cgi7.4
php-cgi    2962 www-data  mem    REG  135,6          547100 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libgpg-error.so.0.29.0 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146553 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libgcrypt.so.20.2.8 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146543 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libexslt.so.0.8.20 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146678 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libxslt.so.1.1.34 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277704 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xsl.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277703 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xmlwriter.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277702 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xmlreader.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277700 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/tokenizer.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277699 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvshm.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277698 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvsem.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277697 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvmsg.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277696 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sqlite3.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277695 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sockets.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277694 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/simplexml.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277693 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/shmop.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146608 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libmd.so.0.0.4 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146524 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libbsd.so.0.11.3 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          547150 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libtinfo.so.6.2 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146537 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libedit.so.2.0.63 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277692 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/readline.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277691 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/posix.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277690 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/phar.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146655 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libsqlite3.so.0.8.6 (path dev=0,19, inode=5834)
php-cgi    2962 www-data  mem    REG  135,6          277689 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/pdo_sqlite.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277686 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/json.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146569 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicui18n.so.67.1 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146571 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicuio.so.67.1 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          267060 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/intl.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          267059 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/iconv.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          267058 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/gettext.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          267057 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ftp.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          267056 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/fileinfo.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146545 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libffi.so.7.1.0 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          267055 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ffi.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          267054 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/exif.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          267053 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/dom.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          267052 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ctype.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          267051 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/calendar.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277701 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xml.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277688 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/pdo.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          547141 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/librt-2.31.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277687 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/opcache.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          547098 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libgcc_s.so.1 (path dev=0,19, inode=2282)
php-cgi    2962 www-data  mem    REG  135,6          146660 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libstdc++.so.6.0.28 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146567 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicudata.so.67.1 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          547106 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/liblzma.so.5.2.5 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146577 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicuuc.so.67.1 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          547135 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libpthread-2.31.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          547080 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libc-2.31.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146653 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libsodium.so.23.3.0 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          547156 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libz.so.1.2.11 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146633 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libpcre2-8.so.0.10.1 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146525 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libcrypto.so.1.1 (path dev=0,19, inode=5546)
php-cgi    2962 www-data  mem    REG  135,6          146658 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libssl.so.1.1 (path dev=0,19, inode=5838)
php-cgi    2962 www-data  mem    REG  135,6          146676 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libxml2.so.2.9.10 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          547090 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libdl-2.31.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          547107 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libm-2.31.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          547139 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libresolv-2.31.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146509 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libargon2.so.1 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          547068 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/ld-2.31.so (stat: No such file or directory)
php-cgi    2963 www-data  txt    REG  135,6  4598608 547932 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/bin/php-cgi7.4
php-cgi    2963 www-data  mem    REG  135,6          547100 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libgpg-error.so.0.29.0 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146553 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libgcrypt.so.20.2.8 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146543 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libexslt.so.0.8.20 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146678 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libxslt.so.1.1.34 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277704 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xsl.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277703 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xmlwriter.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277702 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xmlreader.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277700 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/tokenizer.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277699 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvshm.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277698 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvsem.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277697 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvmsg.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277696 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sqlite3.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277695 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sockets.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277694 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/simplexml.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277693 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/shmop.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146608 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libmd.so.0.0.4 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146524 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libbsd.so.0.11.3 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          547150 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libtinfo.so.6.2 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146537 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libedit.so.2.0.63 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277692 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/readline.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277691 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/posix.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277690 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/phar.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146655 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libsqlite3.so.0.8.6 (path dev=0,19, inode=5834)
php-cgi    2963 www-data  mem    REG  135,6          277689 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/pdo_sqlite.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277686 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/json.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146569 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicui18n.so.67.1 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146571 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicuio.so.67.1 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          267060 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/intl.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          267059 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/iconv.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          267058 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/gettext.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          267057 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ftp.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          267056 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/fileinfo.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146545 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libffi.so.7.1.0 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          267055 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ffi.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          267054 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/exif.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          267053 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/dom.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          267052 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ctype.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          267051 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/calendar.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277701 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xml.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277688 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/pdo.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          547141 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/librt-2.31.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277687 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/opcache.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          547098 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libgcc_s.so.1 (path dev=0,19, inode=2282)
php-cgi    2963 www-data  mem    REG  135,6          146660 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libstdc++.so.6.0.28 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146567 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicudata.so.67.1 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          547106 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/liblzma.so.5.2.5 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146577 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicuuc.so.67.1 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          547135 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libpthread-2.31.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          547080 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libc-2.31.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146653 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libsodium.so.23.3.0 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          547156 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libz.so.1.2.11 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146633 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libpcre2-8.so.0.10.1 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146525 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libcrypto.so.1.1 (path dev=0,19, inode=5546)
php-cgi    2963 www-data  mem    REG  135,6          146658 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libssl.so.1.1 (path dev=0,19, inode=5838)
php-cgi    2963 www-data  mem    REG  135,6          146676 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libxml2.so.2.9.10 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          547090 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libdl-2.31.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          547107 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libm-2.31.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          547139 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libresolv-2.31.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146509 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libargon2.so.1 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          547068 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/ld-2.31.so (stat: No such file or directory)
php-cgi    2964 www-data  txt    REG  135,6  4598608 547932 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/bin/php-cgi7.4
php-cgi    2964 www-data  mem    REG  135,6          547100 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libgpg-error.so.0.29.0 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146553 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libgcrypt.so.20.2.8 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146543 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libexslt.so.0.8.20 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146678 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libxslt.so.1.1.34 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277704 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xsl.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277703 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xmlwriter.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277702 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xmlreader.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277700 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/tokenizer.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277699 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvshm.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277698 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvsem.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277697 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvmsg.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277696 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sqlite3.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277695 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sockets.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277694 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/simplexml.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277693 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/shmop.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146608 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libmd.so.0.0.4 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146524 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libbsd.so.0.11.3 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          547150 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libtinfo.so.6.2 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146537 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libedit.so.2.0.63 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277692 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/readline.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277691 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/posix.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277690 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/phar.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146655 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libsqlite3.so.0.8.6 (path dev=0,19, inode=5834)
php-cgi    2964 www-data  mem    REG  135,6          277689 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/pdo_sqlite.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277686 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/json.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146569 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicui18n.so.67.1 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146571 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicuio.so.67.1 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          267060 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/intl.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          267059 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/iconv.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          267058 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/gettext.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          267057 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ftp.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          267056 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/fileinfo.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146545 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libffi.so.7.1.0 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          267055 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ffi.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          267054 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/exif.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          267053 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/dom.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          267052 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ctype.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          267051 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/calendar.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277701 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xml.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277688 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/pdo.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          547141 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/librt-2.31.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277687 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/opcache.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          547098 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libgcc_s.so.1 (path dev=0,19, inode=2282)
php-cgi    2964 www-data  mem    REG  135,6          146660 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libstdc++.so.6.0.28 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146567 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicudata.so.67.1 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          547106 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/liblzma.so.5.2.5 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146577 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicuuc.so.67.1 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          547135 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libpthread-2.31.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          547080 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libc-2.31.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146653 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libsodium.so.23.3.0 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          547156 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libz.so.1.2.11 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146633 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libpcre2-8.so.0.10.1 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146525 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libcrypto.so.1.1 (path dev=0,19, inode=5546)
php-cgi    2964 www-data  mem    REG  135,6          146658 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libssl.so.1.1 (path dev=0,19, inode=5838)
php-cgi    2964 www-data  mem    REG  135,6          146676 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libxml2.so.2.9.10 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          547090 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libdl-2.31.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          547107 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libm-2.31.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          547139 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libresolv-2.31.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146509 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libargon2.so.1 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          547068 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/ld-2.31.so (stat: No such file or directory)
php-cgi    2965 www-data  txt    REG  135,6  4598608 547932 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/bin/php-cgi7.4
php-cgi    2965 www-data  mem    REG  135,6          547100 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libgpg-error.so.0.29.0 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146553 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libgcrypt.so.20.2.8 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146543 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libexslt.so.0.8.20 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146678 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libxslt.so.1.1.34 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277704 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xsl.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277703 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xmlwriter.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277702 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xmlreader.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277700 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/tokenizer.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277699 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvshm.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277698 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvsem.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277697 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvmsg.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277696 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sqlite3.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277695 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sockets.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277694 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/simplexml.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277693 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/shmop.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146608 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libmd.so.0.0.4 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146524 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libbsd.so.0.11.3 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          547150 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libtinfo.so.6.2 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146537 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libedit.so.2.0.63 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277692 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/readline.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277691 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/posix.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277690 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/phar.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146655 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libsqlite3.so.0.8.6 (path dev=0,19, inode=5834)
php-cgi    2965 www-data  mem    REG  135,6          277689 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/pdo_sqlite.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277686 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/json.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146569 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicui18n.so.67.1 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146571 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicuio.so.67.1 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          267060 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/intl.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          267059 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/iconv.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          267058 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/gettext.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          267057 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ftp.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          267056 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/fileinfo.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146545 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libffi.so.7.1.0 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          267055 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ffi.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          267054 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/exif.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          267053 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/dom.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          267052 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ctype.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          267051 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/calendar.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277701 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xml.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277688 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/pdo.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          547141 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/librt-2.31.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277687 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/opcache.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          547098 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libgcc_s.so.1 (path dev=0,19, inode=2282)
php-cgi    2965 www-data  mem    REG  135,6          146660 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libstdc++.so.6.0.28 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146567 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicudata.so.67.1 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          547106 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/liblzma.so.5.2.5 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146577 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicuuc.so.67.1 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          547135 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libpthread-2.31.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          547080 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libc-2.31.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146653 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libsodium.so.23.3.0 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          547156 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libz.so.1.2.11 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146633 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libpcre2-8.so.0.10.1 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146525 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libcrypto.so.1.1 (path dev=0,19, inode=5546)
php-cgi    2965 www-data  mem    REG  135,6          146658 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libssl.so.1.1 (path dev=0,19, inode=5838)
php-cgi    2965 www-data  mem    REG  135,6          146676 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libxml2.so.2.9.10 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          547090 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libdl-2.31.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          547107 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libm-2.31.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          547139 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libresolv-2.31.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146509 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libargon2.so.1 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          547068 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/ld-2.31.so (stat: No such file or directory)
bash       7645     root  cwd    DIR  135,6     4096 515635 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/cdfdaf5ca65d47f0b8997b4e4029e1b5d98d46651112459240f6ec00b5270775
lsof      11293     root  cwd    DIR  135,6     4096 515635 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/cdfdaf5ca65d47f0b8997b4e4029e1b5d98d46651112459240f6ec00b5270775
lsof      11294     root  cwd    DIR  135,6     4096 515635 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/cdfdaf5ca65d47f0b8997b4e4029e1b5d98d46651112459240f6ec00b5270775

adradr commented 1 year ago

Did you install podman using this method (updated 2 weeks ago)?

pedropombeiro commented 1 year ago

Did you install podman using this method (updated 2 weeks ago)?

No, I used the unifi-blueberry DEB package from https://github.com/unifi-utilities/unifios-utilities/issues/416#issuecomment-1357161167

adradr commented 1 year ago

Did you install podman using this method (updated 2 weeks ago)?

No, I used the unifi-blueberry DEB package from #416 (comment)

Thanks I will take a look. I used the method I linked. Otherwise it works okay, but no docker / docker compose yet.

@adradr did you try delving into /mnt/.rwfs with du -h -d 1 /mnt/.rwfs and proceeding downwards to pinpoint what is causing the 100% usage?

Now I opened the folders under /mnt/.rwfs/var/lib/containers/storage/vfs/dir/.. and it seems like there are 3 types of duplicates with modifications dates before the 2.4.27 upgrade. Before the upgrade I hasn't been using "external" storage drive for podman. But what I don't understand that the changelog states that everything will be lost in the upgrade. Can it be that somehow there are still files remained after the upgrade? And it seems like one of these was the previous pihole container from before the UDM update. 10 Feb 16 00:57 pihole.docker.tag

cd /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir; for i in $(ls ); do ls -lhta $i;done

total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:44 ./
drwxr-xr-x 37 root root 4.0K Nov  7 22:49 etc/
drwxrwxrwt  2 root root 4.0K Nov  7 22:49 tmp/
drwxr-xr-x  7 root root 4.0K Nov  7 22:49 lib/
drwx------  3 root root 4.0K Nov  7 22:48 root/
-rw-r--r--  1 root root   38 Nov  7 22:19 built-for-arch
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:41 ./
drwxrwxrwt  5 root root 4.0K Nov  7 22:47 tmp/
drwxr-xr-x 34 root root 4.0K Nov  7 22:21 etc/
drwx------  2 root root 4.0K Nov  7 22:21 root/
-rw-r--r--  1 root root   38 Nov  7 22:19 built-for-arch
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  7 root root 4.0K Oct 24 02:00 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 3.0M
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 22 root root 4.0K Feb 17 11:38 ./
-rw-r--r--  1 root root    0 Feb 16 01:00 .piholeFirstBoot
drwxrwxrwt  3 root root 4.0K Feb 16 01:00 tmp/
drwxr-xr-x 47 root root 4.0K Feb 16 00:59 etc/
drwxr-xr-x  5 root root 4.0K Feb 16 00:59 run/
drwxr-xr-x  3 root root 4.0K Feb 16 00:59 opt/
-rw-r--r--  1 root root 2.9M Feb 16 00:59 macvendor.db
-rw-r--r--  1 root root   10 Feb 16 00:57 pihole.docker.tag
drwxr-xr-x 11 root root 4.0K Feb 16 00:57 usr/
drwxr-xr-x  2 root root 4.0K Feb 12 03:07 bin/
drwxr-xr-x  2 root root 4.0K Feb 12 03:06 sbin/
drwxr-xr-x 12 root root 4.0K Feb 12 03:06 var/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 dev/
drwxr-xr-x  8 root root 4.0K Feb  8 14:00 lib/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 media/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 mnt/
drwx------  2 root root 4.0K Feb  8 14:00 root/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 srv/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 boot/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 home/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 proc/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 sys/
drwxr-xr-x  2 root root  12K Jun 29  2022 command/
-rwxr-xr-x  1 root root  907 Jun 29  2022 s6-init*
drwxr-xr-x  6 root root 4.0K Jun 29  2022 package/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:39 ./
drwxrwxrwt  4 root root 4.0K Nov  7 22:47 tmp/
drwxr-xr-x 34 root root 4.0K Nov  7 22:21 etc/
drwx------  2 root root 4.0K Nov  7 22:21 root/
-rw-r--r--  1 root root   38 Nov  7 22:19 built-for-arch
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  7 root root 4.0K Oct 24 02:00 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:38 ./
drwxr-xr-x 34 root root 4.0K Nov  7 22:21 etc/
drwx------  2 root root 4.0K Nov  7 22:21 root/
-rw-r--r--  1 root root   38 Nov  7 22:19 built-for-arch
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  7 root root 4.0K Oct 24 02:00 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxrwxrwt  2 root root 4.0K Oct 24 02:00 tmp/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 11:37 ./
-rw-r--r--  1 root root   10 Feb 16 00:57 pihole.docker.tag
drwxr-xr-x 44 root root 4.0K Feb 16 00:57 etc/
drwxr-xr-x 11 root root 4.0K Feb 16 00:57 usr/
drwxr-xr-x  2 root root 4.0K Feb 12 03:07 bin/
drwxr-xr-x  2 root root 4.0K Feb 12 03:06 sbin/
drwxr-xr-x 12 root root 4.0K Feb 12 03:06 var/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 dev/
drwxr-xr-x  8 root root 4.0K Feb  8 14:00 lib/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 media/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 mnt/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 opt/
drwx------  2 root root 4.0K Feb  8 14:00 root/
drwxr-xr-x  3 root root 4.0K Feb  8 14:00 run/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 srv/
drwxrwxrwt  2 root root 4.0K Feb  8 14:00 tmp/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 boot/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 home/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 proc/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 sys/
total 80K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 11:35 ./
drwxr-xr-x 43 root root 4.0K Feb 12 03:17 etc/
drwxr-xr-x  2 root root 4.0K Feb 12 03:07 bin/
drwxr-xr-x  2 root root 4.0K Feb 12 03:06 sbin/
drwxr-xr-x 12 root root 4.0K Feb 12 03:06 var/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 dev/
drwxr-xr-x  8 root root 4.0K Feb  8 14:00 lib/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 media/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 mnt/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 opt/
drwx------  2 root root 4.0K Feb  8 14:00 root/
drwxr-xr-x  3 root root 4.0K Feb  8 14:00 run/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 srv/
drwxrwxrwt  2 root root 4.0K Feb  8 14:00 tmp/
drwxr-xr-x 11 root root 4.0K Feb  8 14:00 usr/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 boot/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 home/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 proc/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:47 ./
-rw-r--r--  1 root root  152 Nov  7 23:17 built-for-arch
drwxrwxrwt  2 root root 4.0K Nov  7 23:00 tmp/
drwxr-xr-x  3 root root 4.0K Nov  7 23:00 opt/
drwxr-xr-x 39 root root 4.0K Nov  7 22:52 etc/
drwx------  3 root root 4.0K Nov  7 22:52 root/
drwxr-xr-x  7 root root 4.0K Nov  7 22:49 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:40 ./
drwxrwxrwt  5 root root 4.0K Nov  7 22:47 tmp/
drwxr-xr-x 34 root root 4.0K Nov  7 22:21 etc/
drwx------  2 root root 4.0K Nov  7 22:21 root/
-rw-r--r--  1 root root   38 Nov  7 22:19 built-for-arch
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  7 root root 4.0K Oct 24 02:00 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 11:43 ./
-rw-r--r--  1 root root   10 Feb 16 00:57 pihole.docker.tag
drwxr-xr-x 43 root root 4.0K Feb 12 03:17 etc/
drwxr-xr-x  2 root root 4.0K Feb 12 03:07 bin/
drwxr-xr-x  2 root root 4.0K Feb 12 03:06 sbin/
drwxr-xr-x 12 root root 4.0K Feb 12 03:06 var/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 dev/
drwxr-xr-x  8 root root 4.0K Feb  8 14:00 lib/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 media/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 mnt/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 opt/
drwx------  2 root root 4.0K Feb  8 14:00 root/
drwxr-xr-x  3 root root 4.0K Feb  8 14:00 run/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 srv/
drwxrwxrwt  2 root root 4.0K Feb  8 14:00 tmp/
drwxr-xr-x 11 root root 4.0K Feb  8 14:00 usr/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 boot/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 home/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 proc/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:45 ./
drwxr-xr-x 39 root root 4.0K Nov  7 22:52 etc/
drwx------  3 root root 4.0K Nov  7 22:52 root/
-rw-r--r--  1 root root   96 Nov  7 22:52 built-for-arch
drwxrwxrwt  2 root root 4.0K Nov  7 22:49 tmp/
drwxr-xr-x  7 root root 4.0K Nov  7 22:49 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 3.0M
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 22 root root 4.0K Feb 17 11:45 ./
-rw-r--r--  1 root root    0 Feb 16 01:00 .piholeFirstBoot
drwxrwxrwt  3 root root 4.0K Feb 16 01:00 tmp/
drwxr-xr-x 47 root root 4.0K Feb 16 00:59 etc/
drwxr-xr-x  5 root root 4.0K Feb 16 00:59 run/
drwxr-xr-x  3 root root 4.0K Feb 16 00:59 opt/
-rw-r--r--  1 root root 2.9M Feb 16 00:59 macvendor.db
-rw-r--r--  1 root root   10 Feb 16 00:57 pihole.docker.tag
drwxr-xr-x 11 root root 4.0K Feb 16 00:57 usr/
drwxr-xr-x  2 root root 4.0K Feb 12 03:07 bin/
drwxr-xr-x  2 root root 4.0K Feb 12 03:06 sbin/
drwxr-xr-x 12 root root 4.0K Feb 12 03:06 var/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 dev/
drwxr-xr-x  8 root root 4.0K Feb  8 14:00 lib/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 media/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 mnt/
drwx------  2 root root 4.0K Feb  8 14:00 root/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 srv/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 boot/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 home/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 proc/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 sys/
drwxr-xr-x  2 root root  12K Jun 29  2022 command/
-rwxr-xr-x  1 root root  907 Jun 29  2022 s6-init*
drwxr-xr-x  6 root root 4.0K Jun 29  2022 package/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:44 ./
-rw-r--r--  1 root root   96 Nov  7 22:52 built-for-arch
drwxr-xr-x 37 root root 4.0K Nov  7 22:49 etc/
drwxrwxrwt  2 root root 4.0K Nov  7 22:49 tmp/
drwxr-xr-x  7 root root 4.0K Nov  7 22:49 lib/
drwx------  3 root root 4.0K Nov  7 22:48 root/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:38 ./
drwxrwxrwt  3 root root 4.0K Nov  7 22:47 tmp/
drwxr-xr-x 34 root root 4.0K Nov  7 22:21 etc/
drwx------  2 root root 4.0K Nov  7 22:21 root/
-rw-r--r--  1 root root   38 Nov  7 22:19 built-for-arch
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  7 root root 4.0K Oct 24 02:00 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:39 ./
drwxrwxrwt  4 root root 4.0K Nov  7 22:47 tmp/
drwxr-xr-x 34 root root 4.0K Nov  7 22:21 etc/
drwx------  2 root root 4.0K Nov  7 22:21 root/
-rw-r--r--  1 root root   38 Nov  7 22:19 built-for-arch
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  7 root root 4.0K Oct 24 02:00 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 80K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 11:33 ./
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 bin/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 dev/
drwxr-xr-x 30 root root 4.0K Feb  8 14:00 etc/
drwxr-xr-x  8 root root 4.0K Feb  8 14:00 lib/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 media/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 mnt/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 opt/
drwx------  2 root root 4.0K Feb  8 14:00 root/
drwxr-xr-x  3 root root 4.0K Feb  8 14:00 run/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 sbin/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 srv/
drwxrwxrwt  2 root root 4.0K Feb  8 14:00 tmp/
drwxr-xr-x 11 root root 4.0K Feb  8 14:00 usr/
drwxr-xr-x 11 root root 4.0K Feb  8 14:00 var/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 boot/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 home/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 proc/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 sys/
total 80K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:36 ./
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x 28 root root 4.0K Oct 24 02:00 etc/
drwxr-xr-x  7 root root 4.0K Oct 24 02:00 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwx------  2 root root 4.0K Oct 24 02:00 root/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxrwxrwt  2 root root 4.0K Oct 24 02:00 tmp/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:47 ./
drwxrwxrwt  2 root root 4.0K Nov  7 23:00 tmp/
drwxr-xr-x  3 root root 4.0K Nov  7 23:00 opt/
drwxr-xr-x 39 root root 4.0K Nov  7 22:52 etc/
drwx------  3 root root 4.0K Nov  7 22:52 root/
-rw-r--r--  1 root root   96 Nov  7 22:52 built-for-arch
drwxr-xr-x  7 root root 4.0K Nov  7 22:49 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:49 ./
drwxr-xr-x 41 root root 4.0K Nov  7 23:20 etc/
drwx------  4 root root 4.0K Nov  7 23:19 root/
drwxr-xr-x  8 root root 4.0K Nov  7 23:19 lib/
drwxr-xr-x  2 root root 4.0K Nov  7 23:18 bin/
-rw-r--r--  1 root root  152 Nov  7 23:17 built-for-arch
drwxrwxrwt  2 root root 4.0K Nov  7 23:00 tmp/
drwxr-xr-x  3 root root 4.0K Nov  7 23:00 opt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:46 ./
drwxr-xr-x  3 root root 4.0K Nov  7 23:00 opt/
drwxr-xr-x 39 root root 4.0K Nov  7 22:52 etc/
drwx------  3 root root 4.0K Nov  7 22:52 root/
-rw-r--r--  1 root root   96 Nov  7 22:52 built-for-arch
drwxrwxrwt  2 root root 4.0K Nov  7 22:49 tmp/
drwxr-xr-x  7 root root 4.0K Nov  7 22:49 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 13:25 ./
drwxr-xr-x 41 root root 4.0K Nov  7 23:20 etc/
drwx------  4 root root 4.0K Nov  7 23:20 root/
drwxrwxrwt  2 root root 4.0K Nov  7 23:20 tmp/
drwxr-xr-x  8 root root 4.0K Nov  7 23:19 lib/
drwxr-xr-x  2 root root 4.0K Nov  7 23:18 bin/
-rw-r--r--  1 root root  152 Nov  7 23:17 built-for-arch
drwxr-xr-x  3 root root 4.0K Nov  7 23:00 opt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 13:24 ./
drwxr-xr-x 41 root root 4.0K Nov  7 23:20 etc/
drwx------  4 root root 4.0K Nov  7 23:20 root/
drwxr-xr-x  8 root root 4.0K Nov  7 23:19 lib/
drwxr-xr-x  2 root root 4.0K Nov  7 23:18 bin/
-rw-r--r--  1 root root  152 Nov  7 23:17 built-for-arch
drwxrwxrwt  2 root root 4.0K Nov  7 23:00 tmp/
drwxr-xr-x  3 root root 4.0K Nov  7 23:00 opt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:37 ./
-rw-r--r--  1 root root   38 Nov  7 22:19 built-for-arch
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x 28 root root 4.0K Oct 24 02:00 etc/
drwxr-xr-x  7 root root 4.0K Oct 24 02:00 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwx------  2 root root 4.0K Oct 24 02:00 root/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxrwxrwt  2 root root 4.0K Oct 24 02:00 tmp/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 80K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 11:34 ./
drwxr-xr-x 43 root root 4.0K Feb 12 03:17 etc/
drwxr-xr-x  2 root root 4.0K Feb 12 03:07 bin/
drwxr-xr-x  2 root root 4.0K Feb 12 03:06 sbin/
drwxr-xr-x 12 root root 4.0K Feb 12 03:06 var/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 dev/
drwxr-xr-x  8 root root 4.0K Feb  8 14:00 lib/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 media/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 mnt/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 opt/
drwx------  2 root root 4.0K Feb  8 14:00 root/
drwxr-xr-x  3 root root 4.0K Feb  8 14:00 run/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 srv/
drwxrwxrwt  2 root root 4.0K Feb  8 14:00 tmp/
drwxr-xr-x 11 root root 4.0K Feb  8 14:00 usr/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 boot/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 home/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 proc/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:45 ./
drwxr-xr-x 39 root root 4.0K Nov  7 22:52 etc/
-rw-r--r--  1 root root   96 Nov  7 22:52 built-for-arch
drwxrwxrwt  2 root root 4.0K Nov  7 22:49 tmp/
drwxr-xr-x  7 root root 4.0K Nov  7 22:49 lib/
drwx------  3 root root 4.0K Nov  7 22:48 root/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:42 ./
drwxrwxrwt  5 root root 4.0K Nov  7 22:47 tmp/
drwxr-xr-x 34 root root 4.0K Nov  7 22:21 etc/
drwx------  2 root root 4.0K Nov  7 22:21 root/
-rw-r--r--  1 root root   38 Nov  7 22:19 built-for-arch
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  7 root root 4.0K Oct 24 02:00 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:37 ./
drwxr-xr-x 34 root root 4.0K Nov  7 22:21 etc/
-rw-r--r--  1 root root   38 Nov  7 22:19 built-for-arch
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  7 root root 4.0K Oct 24 02:00 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwx------  2 root root 4.0K Oct 24 02:00 root/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxrwxrwt  2 root root 4.0K Oct 24 02:00 tmp/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 11:38 ./
-rw-r--r--  1 root root   10 Feb 16 00:57 pihole.docker.tag
drwxr-xr-x 44 root root 4.0K Feb 16 00:57 etc/
drwxr-xr-x 11 root root 4.0K Feb 16 00:57 usr/
drwxr-xr-x  2 root root 4.0K Feb 12 03:07 bin/
drwxr-xr-x  2 root root 4.0K Feb 12 03:06 sbin/
drwxr-xr-x 12 root root 4.0K Feb 12 03:06 var/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 dev/
drwxr-xr-x  8 root root 4.0K Feb  8 14:00 lib/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 media/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 mnt/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 opt/
drwx------  2 root root 4.0K Feb  8 14:00 root/
drwxr-xr-x  3 root root 4.0K Feb  8 14:00 run/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 srv/
drwxrwxrwt  2 root root 4.0K Feb  8 14:00 tmp/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 boot/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 home/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 proc/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 sys/
total 3.0M
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 22 root root 4.0K Feb 17 11:44 ./
-rw-r--r--  1 root root    0 Feb 16 01:00 .piholeFirstBoot
drwxrwxrwt  3 root root 4.0K Feb 16 01:00 tmp/
drwxr-xr-x 47 root root 4.0K Feb 16 00:59 etc/
drwxr-xr-x  5 root root 4.0K Feb 16 00:59 run/
drwxr-xr-x  3 root root 4.0K Feb 16 00:59 opt/
-rw-r--r--  1 root root 2.9M Feb 16 00:59 macvendor.db
-rw-r--r--  1 root root   10 Feb 16 00:57 pihole.docker.tag
drwxr-xr-x 11 root root 4.0K Feb 16 00:57 usr/
drwxr-xr-x  2 root root 4.0K Feb 12 03:07 bin/
drwxr-xr-x  2 root root 4.0K Feb 12 03:06 sbin/
drwxr-xr-x 12 root root 4.0K Feb 12 03:06 var/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 dev/
drwxr-xr-x  8 root root 4.0K Feb  8 14:00 lib/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 media/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 mnt/
drwx------  2 root root 4.0K Feb  8 14:00 root/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 srv/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 boot/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 home/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 proc/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 sys/
drwxr-xr-x  2 root root  12K Jun 29  2022 command/
-rwxr-xr-x  1 root root  907 Jun 29  2022 s6-init*
drwxr-xr-x  6 root root 4.0K Jun 29  2022 package/
total 3.0M
drwxrwxrwt  3 root root 4.0K Feb 17 23:17 tmp/
drwxr-xr-x 47 root root 4.0K Feb 17 14:45 etc/
drwxr-xr-x  9 root root 4.0K Feb 17 14:45 run/
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 22 root root 4.0K Feb 17 11:49 ./
drwxr-xr-x  3 root root 4.0K Feb 16 00:59 opt/
-rw-r--r--  1 root root 2.9M Feb 16 00:59 macvendor.db
-rw-r--r--  1 root root   10 Feb 16 00:57 pihole.docker.tag
drwxr-xr-x 11 root root 4.0K Feb 16 00:57 usr/
drwxr-xr-x  2 root root 4.0K Feb 12 03:07 bin/
drwxr-xr-x  2 root root 4.0K Feb 12 03:06 sbin/
drwxr-xr-x 12 root root 4.0K Feb 12 03:06 var/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 dev/
drwxr-xr-x  8 root root 4.0K Feb  8 14:00 lib/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 media/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 mnt/
drwx------  2 root root 4.0K Feb  8 14:00 root/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 srv/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 boot/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 home/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 proc/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 sys/
drwxr-xr-x  2 root root  12K Jun 29  2022 command/
-rwxr-xr-x  1 root root  907 Jun 29  2022 s6-init*
drwxr-xr-x  6 root root 4.0K Jun 29  2022 package/

adradr commented 1 year ago

Another thing I noticed in the lsof +D /mnt/.rwfs/data/var/lib/containers is that most of the output contains an error stat: No such file or directory at the end of its NAME column. So if I filter out these lines I get 3 directories which I guess are actually read. One of these matches my currently running podman pihole container.

/mnt/.rwfs/data/var/lib/containers/storage/vfs-containers/fae3f45f124598ea127b9871209b9ca45640469183b2525d26f8d7b4277490ca
/mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c
/mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/06448847114b3176a050c39f95fa0acbacd92aa0bd15702b77e129f3bdafc3e5

Do you think I could remove the rest of the folders? @pedropombeiro

pedropombeiro commented 1 year ago

Before the upgrade I hasn't been using "external" storage drive for podman.

Correct me if I'm wrong, but you don't seem to be using an external storage drive for podman in 2.4.27 either. My external SSD drive is at /volume1.

Do you think I could remove the rest of the folders? @pedropombeiro

Personally, I wouldn't touch it while podman is running. If you have an external drive, I would stop podman, delete all images/containers, change /etc/containers/storage.conf to point to the external volume, bring the containers back up, and then delete the /var/lib/containers/storage directory.

bluewalk commented 1 year ago

There are quite a few new things, but in relation to UDM-Boot, when I run "dpkg -i UDM-Boot.deb" command, on_boot.d directory doesn't spawn and I get this error: "Failed to restart udm-boot.service: Unit udm-boot.service has a bad unit file setting. See system logs and 'systemctl status udm-boot.service' for details."

@GY8VSdYYzvL8-K6T have you found a solution for it? I have just upgraded and running into the same issue.

Update I've updated /lib/systemd/system/udm-boot.service and changed ExecStart to

ExecStart=bash -c 'mkdir -p /data/on_boot.d && find -L /data/on_boot.d -mindepth 1 -maxdepth 1 -type f -print0 | sort -z | xargs -0 -r -n 1 -- sh -c '\''if test -x "$0"; then echo "%n: running $0"; "$0"; else case "$0" in *.sh) echo "%n: sourcing $0"; . "$0";; *) echo "%n: ignoring $0";; esac; fi'\'

As it needs bash to run and was also using the wrong paths. I got the info from the udmse_on_boot_systemd function from the install script, which I didn't use (stupid me). If using the script it should be fine

ghost commented 1 year ago

There are quite a few new things, but in relation to UDM-Boot, when I run "dpkg -i UDM-Boot.deb" command, on_boot.d directory doesn't spawn and I get this error: "Failed to restart udm-boot.service: Unit udm-boot.service has a bad unit file setting. See system logs and 'systemctl status udm-boot.service' for details."

@GY8VSdYYzvL8-K6T have you found a solution for it? I have just upgraded and running into the same issue.

Update I've updated /lib/systemd/system/udm-boot.service and changed ExecStart to
ExecStart=bash -c 'mkdir -p /data/on_boot.d && find -L /data/on_boot.d -mindepth 1 -maxdepth 1 -type f -print0 | sort -z | xargs -0 -r -n 1 -- sh -c '\''if test -x "$0"; then echo "%n: running $0"; "$0"; else case "$0" in *.sh) echo "%n: sourcing $0"; . "$0";; *) echo "%n: ignoring $0";; esac; fi'\'
As it needs bash to run and was also using the wrong paths. I got the info from the udmse_on_boot_systemd function from the install script, which I didn't use (stupid me). If using the script it should be fine

I don't know Linux scripting and commands that well. I know the remote script works without any errors and creates the needed on-boot directory, but it also installs Podman, which I do not think I need because I use simple on-boot scripts, such as SysCTL tweaks, IPTables, EBTables, IFConfig, and don't use any additional applications. Maybe I am wrong and I do need Podman for such scripts...?

This is the working script I mentioned above: curl -fsL "https://raw.githubusercontent.com/unifi-utilities/unifios-utilities/HEAD/on-boot-script/remote_install.sh" | /bin/sh

I am not able to extract needed information from it to isolate the parts I need (on-boot directory and on-boot service without podman).

I'd appreciate if someone can just create a fully functional DEB file I can use offline after factory reset without having to be connected to the Internet.

adradr commented 1 year ago

Before the upgrade I hasn't been using "external" storage drive for podman.

Correct me if I'm wrong, but you don't seem to be using an external storage drive for podman in 2.4.27 either. My external SSD drive is at /volume1.

Do you think I could remove the rest of the folders? @pedropombeiro

Personally, I wouldn't touch it while podman is running. If you have an external drive, I would stop podman, delete all images/containers, change /etc/containers/storage.conf to point to the external volume, bring the containers back up, and then delete the /var/lib/containers/storage directory.

I tried the method you mentioned but does not wants to update podman to the new path... I even removed the podman install script from on_boot.d and installed podman using the .deb package you mentioned from another thread.

cat /etc/containers/storage.conf

[storage]
driver = "vfs"
runroot = "/volume1/run/containers/storage"
graphroot = "/volume1/var/lib/containers/storage"

podman info

WARN[0000] Failed to read current user namespace mappings
host:
  arch: arm64
  buildahVersion: 1.28.0
...
store:
  configFile: /etc/containers/storage.conf
...
  graphDriverName: vfs
...
  graphRoot: /var/lib/containers/storage
  graphRootAllocated: 9935884288
  graphRootUsed: 9086468096
  graphStatus: {}
  imageCopyTmpDir: /var/tmp
  imageStore:
    number: 1
  runRoot: /run/containers/storage
  volumePath: /var/lib/containers/storage/volumes
...

dsng138 commented 1 year ago

I own an UDMB currently running on 1.12.38.

First question may I know if i need to remove all the container in podman except unifiOS before upgrade?

Second question is do the latest release work on unifiOS 2.x?

Thanks for help.

This is my first time comment here

dvcrn commented 1 year ago

You don't need to remove anything. The upgrade process will wipe your UDM so make sure you have a backup

And yes the latest releases work on unifiOS 2.x. Sometimes a bit wonky but so far no major issues besides what's written in this thread

dsng138 commented 1 year ago

You don't need to remove anything. The upgrade process will wipe your UDM so make sure you have a backup

And yes the latest releases work on unifiOS 2.x. Sometimes a bit wonky but so far no major issues besides what's written in this thread

Cool! Good to hear, once the upgrade complete I follow the instructions in the main page and I will be good to go?

Thanks again!

bluewalk commented 1 year ago

Cool! Good to hear, once the upgrade complete I follow the instructions in the main page and I will be good to go?

Yep, just install by running the script. This will correct issues with systems as well. Also if you use podman make sure to follow the instructions here: https://github.com/unifi-utilities/unifios-utilities/tree/main/podman-install

unifi-utilities / unifios-utilities

UniFi OS - Dream Machines 2.x #416