[BUG] immich_machine_learning uses excessive amount of space

[tnys]

The bug

After a few hours of scanning an external library with 100GB of pictures (JPEG, HEIC, MOV, ..) immich_machine_learning uses an excessive amount of diskspace. Output of

docker system df -v

CONTAINER ID   IMAGE                                                COMMAND                  LOCAL VOLUMES   SIZE      CREATED        STATUS         NAMES
df844b6611df   ghcr.io/immich-app/immich-proxy:release              "/docker-entrypoint.…"   0               1.34kB    2 days ago     Up 4 minutes   immich_proxy
236e4eaab27b   ghcr.io/immich-app/immich-server:release             "tini -- /bin/sh sta…"   0               0B        2 days ago     Up 4 minutes   immich_server
fd51e8b41d73   ghcr.io/immich-app/immich-machine-learning:release   "tini -- ./start.sh"     0               51.8GB    2 days ago     Up 4 minutes   immich_machine_learning
047a88463ab1   ghcr.io/immich-app/immich-server:release             "tini -- /bin/sh sta…"   0               34.9MB    2 days ago     Up 4 minutes   immich_microservices
965341bc2997   ghcr.io/immich-app/immich-web:release                "tini -- /bin/sh ent…"   0               0B        2 days ago     Up 4 minutes   immich_web
bb70d2b0ff1f   redis:6.2-alpine                                     "docker-entrypoint.s…"   1               0B        2 days ago     Up 4 minutes   immich_redis
bc1d6851854c   postgres:14-alpine                                   "docker-entrypoint.s…"   0               63B       2 days ago     Up 4 minutes   immich_postgres
5f36c355f926   typesense/typesense:0.24.1                           "/opt/typesense-serv…"   0               0B        2 days ago     Up 4 minutes   immich_typesense

shows 54GB!

The OS that Immich Server is running on

Ubuntu 22.04

Version of Immich Server

v1.86.0

Version of Immich Mobile App

v1.86.0

Platform with the issue

• [X] Server
• [ ] Web
• [ ] Mobile

Your docker-compose.yml content

Last login: Wed Nov 15 09:04:00 on ttys000
tnys@Toms-MacBook-Pro-2 ~ % ssh -l tom 192.168.1.128
tom@192.168.1.128's password: 
Welcome to Ubuntu 22.04.3 LTS (GNU/Linux 5.15.0-88-generic x86_64)

 * Documentation:  https://help.ubuntu.com
 * Management:     https://landscape.canonical.com
 * Support:        https://ubuntu.com/advantage

  System information as of Mon Nov 13 10:34:27 PM CET 2023

  System load:                      3.04443359375
  Usage of /:                       29.1% of 97.87GB
  Memory usage:                     40%
  Swap usage:                       0%
  Temperature:                      45.0 C
  Processes:                        263
  Users logged in:                  0
  IPv4 address for br-1febe07ae84f: 172.19.0.1
  IPv4 address for br-426557c32f9a: 172.18.0.1
  IPv4 address for br-9eff467347d5: 172.20.0.1
top - 19:42:20 up 2 days, 20:59,  1 user,  load average: 11.36, 8.20, 7.41
Tasks: 315 total,   8 running, 307 sleeping,   0 stopped,   0 zombie
%Cpu(s): 69.2 us, 17.6 sy,  0.0 ni,  2.4 id,  7.9 wa,  0.0 hi,  2.9 si,  0.0 st
MiB Mem :  15828.8 total,    963.6 free,   5831.5 used,   9033.6 buff/cache
MiB Swap:   4096.0 total,   3177.7 free,    918.2 used.   9305.0 avail Mem 

    PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND                                                                                               
2021555 root      20   0   22.0g 555088  30432 R 101.0   3.4   6:03.54 immich_microser                                                                                       
2722661 root      20   0  612676 111284  37732 R  89.4   0.7   0:02.69 gunicorn                                                                                              
   2604 www-data  20   0 6392244 875192  16740 S  34.2   5.4 435:48.64 uwsgi                                                                                                 
   2095 root      20   0  726404  10960      4 S  10.3   0.1 960:42.24 go2rtc                                                                                                
     43 root      20   0       0      0      0 S   8.6   0.0  18:08.54 kcompactd0                                                                                            
   2115 root      20   0 2818008 259976   9696 S   8.6   1.6 502:21.14 python3                                                                                               
   2512 root      20   0 1035544  93104   6756 S   8.6   0.6 778:55.27 frigate.process                                                                                       
2721738 root      20   0   36880  34148   4696 R   8.3   0.2   0:05.85 exiftool                                                                                              
   2489 root      20   0 1022776  50116   6600 S   7.3   0.3 122:14.92 frigate.process                                                                                       
2721737 70        20   0  173528  28096  24128 D   4.0   0.2   0:01.10 postgres                                                                                              
   2481 root      20   0 1013656  51344   8428 S   3.7   0.3 317:19.90 frigate.detecto                                                                                       
   2506 root      20   0 1026476  53644   6600 S   2.7   0.3 336:11.86 frigate.process                                                                                       
2721740 70        20   0  173532  27480  23520 S   2.7   0.2   0:00.74 postgres                                                                                              
2721751 70        20   0  173460  27824  23820 S   2.7   0.2   0:01.09 postgres                                                                                              
2721766 70        20   0  173488  27184  23236 R   2.7   0.2   0:00.90 postgres                                                                                              
2721708 70        20   0  173552  28232  24160 S   2.3   0.2   0:01.00 postgres                                                                                              
2721735 70        20   0  173552  28228  24172 R   2.3   0.2   0:01.17 postgres                                                                                              
2721739 70        20   0  173548  27932  23904 S   2.3   0.2   0:00.98 postgres                                                                                              
2721759 70        20   0  173816  28020  23792 S   2.3   0.2   0:00.78 postgres                                                                                              
   2482 root      20   0 1460340  39088   5224 S   2.0   0.2 158:07.19 frigate.output                                                                                        
   2524 root      20   0  538948  38632  19536 S   2.0   0.2 157:19.88 ffmpeg                                                                                                
   2587 root      20   0  538828  42904  19664 S   2.0   0.3 172:48.93 ffmpeg                                                                                                
   2594 root      20   0  130328  19064  16072 S   2.0   0.1 148:18.14 ffmpeg                                                                                                
 960160 root      20   0  541404  45492  19752 S   2.0   0.3  92:16.81 ffmpeg                                                                                                
1499611 root      20   0  538712  49064  19552 S   2.0   0.3  69:33.86 ffmpeg                                                                                                
   2543 root      20   0  544384  35064  19460 S   1.7   0.2 144:49.42 ffmpeg                                                                                                
   2574 root      20   0  535308  35764  19708 S   1.7   0.2 148:30.57 ffmpeg                                                                                                
 675056 root      20   0  537540  41008  18892 S   1.7   0.3  91:40.71 ffmpeg                                                                                                
1193537 root      20   0  536324  39292  18780 S   1.7   0.2  62:57.04 ffmpeg                                                                                                
1619644 lxd       20   0   49448  18736   3420 S   1.7   0.1   5:20.35 redis-server                                                                                          
   2882 root      20   0  535780  36504  19900 S   1.3   0.2 152:05.42 ffmpeg                                                                                                
   2513 root      20   0 1018636  39124   3644 S   1.0   0.2  59:53.98 frigate.capture                                                                                       
   2544 root      20   0 1020132  39632   3724 S   1.0   0.2  70:31.35 frigate.capture                                                                                       
   2562 root      20   0 1015628  42324   4216 S   1.0   0.3  77:40.52 frigate.capture                                                                                       
1193539 root      20   0  130396  21568  16820 S   1.0   0.1  34:58.30 ffmpeg                                                                                                
2636095 root      20   0       0      0      0 I   1.0   0.0   0:22.72 kworker/u8:1-i915                                                                                     
2689403 root      20   0       0      0      0 I   1.0   0.0   0:14.41 kworker/u8:0-i915                                                                                     
2721733 70        20   0  173484  28072  24140 R   1.0   0.2   0:01.02 postgres                                                                                              
     28 root      20   0       0      0      0 S   0.7   0.0  33:16.45 ksoftirqd/2                                                                                           
   2480 root      20   0   14256   4436   4068 S   0.7   0.0  54:02.39 python3                                                                                               
   2487 root      20   0 1020020  47560   6600 S   0.7   0.3  67:25.03 frigate.process                                                                                       
   2492 root      20   0 1021776  49276   6600 S   0.7   0.3  77:22.15 frigate.process                                                                                       
   2504 root      20   0 1021256  48584   6600 S   0.7   0.3 119:47.15 frigate.process                                                                                       
   2507 root      20   0 1020900  47928   6600 S   0.7   0.3 323:12.48 frigate.process                                                                                       
   2510 root      20   0 1021456  49064   6600 S   0.7   0.3 102:31.77 frigate.process                                                                                       
   2514 root      20   0 1015628  41028   4280 S   0.7   0.3  69:55.63 frigate.capture                                                                                       
   2526 root      20   0 1020132  39736   3972 S   0.7   0.2  73:19.98 frigate.capture                                                                                       
   2529 root      20   0 1020132  39996   4024 S   0.7   0.2  72:42.45 frigate.capture                                                                                       
   2557 root      20   0 1019876  39296   3648 S   0.7   0.2  70:59.62 frigate.capture                                                                                       
1620311 70        20   0  170976   7236   5192 S   0.7   0.0   1:34.98 postgres                                                                                              
1731051 tom       20   0   18600  11408   5480 S   0.7   0.1  32:01.68 ssh                                                                                                   
2717487 root      20   0       0      0      0 I   0.7   0.0   0:03.98 kworker/2:1-events                                                                                    
2721734 70        20   0  173468  28060  24068 S   0.7   0.2   0:00.91 postgres                                                                                              
     14 root      20   0       0      0      0 I   0.3   0.0   9:37.47 rcu_sched                                                                                             
     34 root      20   0       0      0      0 S   0.3   0.0  33:40.49 ksoftirqd/3                                                                                           
    994 root      20   0 3107312  37948   3272 S   0.3   0.2  21:44.91 dockerd                                                                                               
tom@frigate:~$ client_loop: send disconnect: Broken pipe
tnys@Toms-MacBook-Pro-2 ~ % ssh -l tom 192.168.1.128
tom@192.168.1.128's password: 
Welcome to Ubuntu 22.04.3 LTS (GNU/Linux 5.15.0-88-generic x86_64)

 * Documentation:  https://help.ubuntu.com
 * Management:     https://landscape.canonical.com
 * Support:        https://ubuntu.com/advantage

  System information as of Mon Nov 13 10:34:27 PM CET 2023

  System load:                      3.04443359375
  Usage of /:                       29.1% of 97.87GB
  Memory usage:                     40%
  Swap usage:                       0%
  Temperature:                      45.0 C
  Processes:                        263
  Users logged in:                  0
  IPv4 address for br-1febe07ae84f: 172.19.0.1
  IPv4 address for br-426557c32f9a: 172.18.0.1
  IPv4 address for br-9eff467347d5: 172.20.0.1
  IPv4 address for docker0:         172.17.0.1
  IPv4 address for eno1:            192.168.1.128
  IPv6 address for eno1:            fd79:ddca:4e2d:45d8:de4a:3eff:feea:9be4

 * Strictly confined Kubernetes makes edge and IoT secure. Learn how MicroK8s
   just raised the bar for easy, resilient and secure K8s cluster deployment.

   https://ubuntu.com/engage/secure-kubernetes-at-the-edge

Expanded Security Maintenance for Applications is not enabled.

1 update can be applied immediately.
To see these additional updates run: apt list --upgradable

Enable ESM Apps to receive additional future security updates.
See https://ubuntu.com/esm or run: sudo pro status

Last login: Wed Nov 15 19:40:31 2023 from 192.168.1.249
tom@frigate:~$ docker-compose pull
ERROR: 
        Can't find a suitable configuration file in this directory or any
        parent. Are you in the right directory?

        Supported filenames: docker-compose.yml, docker-compose.yaml, compose.yml, compose.yaml

tom@frigate:~$ ls -l
total 28
drwxrwxr-x 3 tom tom 4096 May 16  2023 compreface
drwxrwxr-x 2 tom tom 4096 May 16  2023 doubletake
-rwxrwxr-x 1 tom tom 1147 Apr 30  2023 extractor.py
drwxrwxr-x 2 tom tom 4096 Nov 12 20:17 frigate
drwxrwxr-x 3 tom tom 4096 Nov 14 20:10 immich
-rwxrwxr-x 1 tom tom   44 Apr 29  2023 screen-off.sh
-rwxrwxrwx 1 tom tom  399 Nov 14 18:42 sync-photos.sh
tom@frigate:~$ cd immich/
tom@frigate:~/immich$ docker-compose pull
Pulling immich-machine-learning ... done
Pulling immich-web              ... done
Pulling typesense               ... done
Pulling redis                   ... done
Pulling database                ... done
Pulling immich-microservices    ... done
Pulling immich-server           ... done
Pulling immich-proxy            ... done
tom@frigate:~/immich$ docker-compose restart
Restarting immich_proxy            ... done
Restarting immich_server           ... done
Restarting immich_machine_learning ... done
Restarting immich_microservices    ... done
Restarting immich_web              ... done
Restarting immich_redis            ... done
Restarting immich_postgres         ... done
Restarting immich_typesense        ... done
tom@frigate:~/immich$ docker-compose stop
Stopping immich_proxy            ... done
Stopping immich_server           ... done
Stopping immich_machine_learning ... done
Stopping immich_microservices    ... done
Stopping immich_web              ... done
Stopping immich_redis            ... done
Stopping immich_postgres         ... done
Stopping immich_typesense        ... done
tom@frigate:~/immich$ docker-compose up -d
Starting immich_postgres         ... done
Starting immich_typesense        ... done
Starting immich_redis            ... done
Starting immich_machine_learning ... done
Starting immich_web              ... done
Starting immich_server           ... done
Starting immich_microservices    ... done
Starting immich_proxy            ... done
tom@frigate:~/immich$ cd /media/photos-usb/
tom@frigate:/media/photos-usb$ sudo ncdu
[sudo] password for tom: 
tom@frigate:/media/photos-usb$ docker system df -v
Images space usage:

REPOSITORY                                   TAG       IMAGE ID       CREATED         SIZE      SHARED SIZE   UNIQUE SIZE   CONTAINERS
ghcr.io/immich-app/immich-server             release   9070d65289d4   3 days ago      1.04GB    0B            1.039GB       2
ghcr.io/immich-app/immich-machine-learning   release   f95503aade89   3 days ago      1.66GB    131.9MB       1.524GB       1
ghcr.io/immich-app/immich-web                release   2f6fa725e19d   3 days ago      279MB     182.3MB       96.75MB       1
ghcr.io/immich-app/immich-proxy              release   d0fba67722ab   4 days ago      41.4MB    0B            41.4MB        1
<none>                                       <none>    5079d97de4a7   9 days ago      1.78GB    0B            1.783GB       0
<none>                                       <none>    9c0be69a9d0d   9 days ago      1.66GB    131.9MB       1.524GB       0
<none>                                       <none>    774a2ce99c19   9 days ago      242MB     182.3MB       59.94MB       0
<none>                                       <none>    acab9c0daace   3 months ago    46.2MB    0B            46.15MB       0
<none>                                       <none>    b9cad9a5aff9   5 months ago    27.4MB    7.332MB       20.06MB       1
<none>                                       <none>    2e0bc99c553f   5 months ago    235MB     7.332MB       228MB         1
ghcr.io/blakeblackshear/frigate              stable    dac652c4cf36   5 months ago    1.73GB    0B            1.726GB       1
<none>                                       <none>    de9eadc78acf   7 months ago    799MB     0B            799.1MB       1
exadel/compreface-core                       1.1.0     5290baadf481   8 months ago    3.9GB     0B            3.902GB       1
exadel/compreface-fe                         1.1.0     17009d953414   8 months ago    137MB     0B            137.4MB       1
exadel/compreface-admin                      1.1.0     e87cbdfceac1   8 months ago    275MB     204.5MB       70.42MB       1
exadel/compreface-api                        1.1.0     5a43c73defd1   8 months ago    361MB     204.5MB       156.5MB       1
exadel/compreface-postgres-db                1.1.0     ac2bc098a670   8 months ago    293MB     0B            293.3MB       1
jakowenko/double-take                        latest    0e6b4a512765   12 months ago   1.07GB    0B            1.069GB       1

Containers space usage:

CONTAINER ID   IMAGE                                                COMMAND                  LOCAL VOLUMES   SIZE      CREATED        STATUS                          NAMES
df844b6611df   ghcr.io/immich-app/immich-proxy:release              "/docker-entrypoint.…"   0               1.34kB    2 days ago     Up 4 minutes                    immich_proxy
236e4eaab27b   ghcr.io/immich-app/immich-server:release             "tini -- /bin/sh sta…"   0               0B        2 days ago     Up 4 minutes                    immich_server
fd51e8b41d73   ghcr.io/immich-app/immich-machine-learning:release   "tini -- ./start.sh"     0               51.7GB    2 days ago     Up 4 minutes                    immich_machine_learning
047a88463ab1   ghcr.io/immich-app/immich-server:release             "tini -- /bin/sh sta…"   0               34.9MB    2 days ago     Up 4 minutes                    immich_microservices
965341bc2997   ghcr.io/immich-app/immich-web:release                "tini -- /bin/sh ent…"   0               0B        2 days ago     Up 4 minutes                    immich_web
bb70d2b0ff1f   redis:6.2-alpine                                     "docker-entrypoint.s…"   1               0B        2 days ago     Up 4 minutes                    immich_redis
bc1d6851854c   postgres:14-alpine                                   "docker-entrypoint.s…"   0               63B       2 days ago     Up 4 minutes                    immich_postgres
5f36c355f926   typesense/typesense:0.24.1                           "/opt/typesense-serv…"   0               0B        2 days ago     Up 4 minutes                    immich_typesense
d3529ff457c7   ghcr.io/blakeblackshear/frigate:stable               "/init"                  0               316kB     4 months ago   Up 4 days                       frigate
3bceeef4a801   exadel/compreface-fe:1.1.0                           "/docker-entrypoint.…"   0               2.39kB    6 months ago   Up 4 days                       compreface-ui
b4acfdf9bed6   exadel/compreface-admin:1.1.0                        "sh -c 'java $ADMIN_…"   0               32.8kB    6 months ago   Up 4 days                       compreface-admin
7d51d9cc9274   exadel/compreface-api:1.1.0                          "sh -c 'java $API_JA…"   0               253MB     6 months ago   Up 4 days                       compreface-api
6a2daa7ea44a   exadel/compreface-core:1.1.0                         "uwsgi --ini uwsgi.i…"   0               0B        6 months ago   Up 4 days                       compreface-core
e9c448f08f0d   exadel/compreface-postgres-db:1.1.0                  "docker-entrypoint.s…"   1               0B        6 months ago   Restarting (1) 51 seconds ago   compreface-postgres-db
bf65a5dee95e   jakowenko/double-take                                "/bin/bash ./entrypo…"   1               16.1kB    6 months ago   Up 4 days                       double-take

Local Volumes space usage:

VOLUME NAME                                                        LINKS     SIZE
d26ba5e384d78a17592a2259c8c48bc57d01f7263bcdfe6f714db8078374cd13   0         904B
1fa2ee8f30c9868a26c4427a09eddcca4161547602d4e7e5b4f364e082f2969a   0         904B
compreface_postgres-data                                           1         197.5MB
immich_pgdata                                                      0         77.68MB
immich_tsdata                                                      0         66.06MB
e30619b389888720ca5a91c7f791ad5f74c97743d3359565afe91cc0c3f0c8dd   0         648.3kB
doubletake_double-take                                             1         443.5MB
c50e00b688e6af63b642c0fc43a8891644050bac27b0c978333daaed8c3cf1b3   0         1.666kB
b65aec6e3bf3032dca29055d095f019d001dead5ef48ccc6a51059bde9cd00bb   0         904B
528ebd5a2bf61b444f43d3dbfd7abd67d27a9bb7091ed6c3f6e0a26d4109662f   1         6.631MB
immich_model-cache                                                 0         1.005GB
45d53d4b6b9ff2f28ce866f542e652e57603d23cad6ce73c3ced076a4fb08e20   0         1.54kB
b97ef4d1ef972d1ac075a02ff7a989cb63097e5920ef72eda8d5e4d6d704d048   0         1.801kB
915b9e10c271abfc78b81be6e5c44fc390437a0dc7384e18a5b16fff4a0b25b4   0         659.1kB

Build cache usage: 0B

CACHE ID   CACHE TYPE   SIZE      CREATED   LAST USED   USAGE     SHARED
tom@frigate:/media/photos-usb$ docker system df -v
Images space usage:

REPOSITORY                                   TAG       IMAGE ID       CREATED         SIZE      SHARED SIZE   UNIQUE SIZE   CONTAINERS
ghcr.io/immich-app/immich-server             release   9070d65289d4   3 days ago      1.04GB    0B            1.039GB       2
ghcr.io/immich-app/immich-machine-learning   release   f95503aade89   3 days ago      1.66GB    131.9MB       1.524GB       1
ghcr.io/immich-app/immich-web                release   2f6fa725e19d   3 days ago      279MB     182.3MB       96.75MB       1
ghcr.io/immich-app/immich-proxy              release   d0fba67722ab   4 days ago      41.4MB    0B            41.4MB        1
<none>                                       <none>    5079d97de4a7   9 days ago      1.78GB    0B            1.783GB       0
<none>                                       <none>    9c0be69a9d0d   9 days ago      1.66GB    131.9MB       1.524GB       0
<none>                                       <none>    774a2ce99c19   9 days ago      242MB     182.3MB       59.94MB       0
<none>                                       <none>    acab9c0daace   3 months ago    46.2MB    0B            46.15MB       0
<none>                                       <none>    b9cad9a5aff9   5 months ago    27.4MB    7.332MB       20.06MB       1
<none>                                       <none>    2e0bc99c553f   5 months ago    235MB     7.332MB       228MB         1
ghcr.io/blakeblackshear/frigate              stable    dac652c4cf36   5 months ago    1.73GB    0B            1.726GB       1
<none>                                       <none>    de9eadc78acf   7 months ago    799MB     0B            799.1MB       1
exadel/compreface-core                       1.1.0     5290baadf481   8 months ago    3.9GB     0B            3.902GB       1
exadel/compreface-fe                         1.1.0     17009d953414   8 months ago    137MB     0B            137.4MB       1
exadel/compreface-admin                      1.1.0     e87cbdfceac1   8 months ago    275MB     204.5MB       70.42MB       1
exadel/compreface-api                        1.1.0     5a43c73defd1   8 months ago    361MB     204.5MB       156.5MB       1
exadel/compreface-postgres-db                1.1.0     ac2bc098a670   8 months ago    293MB     0B            293.3MB       1
jakowenko/double-take                        latest    0e6b4a512765   12 months ago   1.07GB    0B            1.069GB       1

Containers space usage:

CONTAINER ID   IMAGE                                                COMMAND                  LOCAL VOLUMES   SIZE      CREATED        STATUS                          NAMES
df844b6611df   ghcr.io/immich-app/immich-proxy:release              "/docker-entrypoint.…"   0               1.34kB    2 days ago     Up 5 minutes                    immich_proxy
236e4eaab27b   ghcr.io/immich-app/immich-server:release             "tini -- /bin/sh sta…"   0               0B        2 days ago     Up 5 minutes                    immich_server
fd51e8b41d73   ghcr.io/immich-app/immich-machine-learning:release   "tini -- ./start.sh"     0               51.8GB    2 days ago     Up 5 minutes                    immich_machine_learning
047a88463ab1   ghcr.io/immich-app/immich-server:release             "tini -- /bin/sh sta…"   0               34.9MB    2 days ago     Up 5 minutes                    immich_microservices
965341bc2997   ghcr.io/immich-app/immich-web:release                "tini -- /bin/sh ent…"   0               0B        2 days ago     Up 5 minutes                    immich_web
bb70d2b0ff1f   redis:6.2-alpine                                     "docker-entrypoint.s…"   1               0B        2 days ago     Up 5 minutes                    immich_redis
bc1d6851854c   postgres:14-alpine                                   "docker-entrypoint.s…"   0               63B       2 days ago     Up 5 minutes                    immich_postgres
5f36c355f926   typesense/typesense:0.24.1                           "/opt/typesense-serv…"   0               0B        2 days ago     Up 5 minutes                    immich_typesense
d3529ff457c7   ghcr.io/blakeblackshear/frigate:stable               "/init"                  0               316kB     4 months ago   Up 4 days                       frigate
3bceeef4a801   exadel/compreface-fe:1.1.0                           "/docker-entrypoint.…"   0               2.39kB    6 months ago   Up 4 days                       compreface-ui
b4acfdf9bed6   exadel/compreface-admin:1.1.0                        "sh -c 'java $ADMIN_…"   0               32.8kB    6 months ago   Up 4 days                       compreface-admin
7d51d9cc9274   exadel/compreface-api:1.1.0                          "sh -c 'java $API_JA…"   0               253MB     6 months ago   Up 4 days                       compreface-api
6a2daa7ea44a   exadel/compreface-core:1.1.0                         "uwsgi --ini uwsgi.i…"   0               0B        6 months ago   Up 4 days                       compreface-core
e9c448f08f0d   exadel/compreface-postgres-db:1.1.0                  "docker-entrypoint.s…"   1               0B        6 months ago   Restarting (1) 41 seconds ago   compreface-postgres-db
bf65a5dee95e   jakowenko/double-take                                "/bin/bash ./entrypo…"   1               16.1kB    6 months ago   Up 4 days                       double-take

Local Volumes space usage:

VOLUME NAME                                                        LINKS     SIZE
b97ef4d1ef972d1ac075a02ff7a989cb63097e5920ef72eda8d5e4d6d704d048   0         1.801kB
915b9e10c271abfc78b81be6e5c44fc390437a0dc7384e18a5b16fff4a0b25b4   0         659.1kB
1fa2ee8f30c9868a26c4427a09eddcca4161547602d4e7e5b4f364e082f2969a   0         904B
compreface_postgres-data                                           1         197.5MB
immich_pgdata                                                      0         77.68MB
immich_tsdata                                                      0         66.06MB
e30619b389888720ca5a91c7f791ad5f74c97743d3359565afe91cc0c3f0c8dd   0         648.3kB
d26ba5e384d78a17592a2259c8c48bc57d01f7263bcdfe6f714db8078374cd13   0         904B
doubletake_double-take                                             1         443.5MB
c50e00b688e6af63b642c0fc43a8891644050bac27b0c978333daaed8c3cf1b3   0         1.666kB
b65aec6e3bf3032dca29055d095f019d001dead5ef48ccc6a51059bde9cd00bb   0         904B
528ebd5a2bf61b444f43d3dbfd7abd67d27a9bb7091ed6c3f6e0a26d4109662f   1         6.631MB
immich_model-cache                                                 0         1.005GB
45d53d4b6b9ff2f28ce866f542e652e57603d23cad6ce73c3ced076a4fb08e20   0         1.54kB

Build cache usage: 0B

CACHE ID   CACHE TYPE   SIZE      CREATED   LAST USED   USAGE     SHARED
tom@frigate:/media/photos-usb$ docker system df -v
Images space usage:

REPOSITORY                                   TAG       IMAGE ID       CREATED         SIZE      SHARED SIZE   UNIQUE SIZE   CONTAINERS
ghcr.io/immich-app/immich-server             release   9070d65289d4   3 days ago      1.04GB    0B            1.039GB       2
ghcr.io/immich-app/immich-machine-learning   release   f95503aade89   3 days ago      1.66GB    131.9MB       1.524GB       1
ghcr.io/immich-app/immich-web                release   2f6fa725e19d   3 days ago      279MB     182.3MB       96.75MB       1
ghcr.io/immich-app/immich-proxy              release   d0fba67722ab   4 days ago      41.4MB    0B            41.4MB        1
<none>                                       <none>    5079d97de4a7   9 days ago      1.78GB    0B            1.783GB       0
<none>                                       <none>    9c0be69a9d0d   9 days ago      1.66GB    131.9MB       1.524GB       0
<none>                                       <none>    774a2ce99c19   9 days ago      242MB     182.3MB       59.94MB       0
<none>                                       <none>    acab9c0daace   3 months ago    46.2MB    0B            46.15MB       0
<none>                                       <none>    b9cad9a5aff9   5 months ago    27.4MB    7.332MB       20.06MB       1
<none>                                       <none>    2e0bc99c553f   5 months ago    235MB     7.332MB       228MB         1
ghcr.io/blakeblackshear/frigate              stable    dac652c4cf36   5 months ago    1.73GB    0B            1.726GB       1
<none>                                       <none>    de9eadc78acf   7 months ago    799MB     0B            799.1MB       1
exadel/compreface-core                       1.1.0     5290baadf481   8 months ago    3.9GB     0B            3.902GB       1
exadel/compreface-fe                         1.1.0     17009d953414   8 months ago    137MB     0B            137.4MB       1
exadel/compreface-admin                      1.1.0     e87cbdfceac1   8 months ago    275MB     204.5MB       70.42MB       1
exadel/compreface-api                        1.1.0     5a43c73defd1   8 months ago    361MB     204.5MB       156.5MB       1
exadel/compreface-postgres-db                1.1.0     ac2bc098a670   8 months ago    293MB     0B            293.3MB       1
jakowenko/double-take                        latest    0e6b4a512765   12 months ago   1.07GB    0B            1.069GB       1

Containers space usage:

CONTAINER ID   IMAGE                                                COMMAND                  LOCAL VOLUMES   SIZE      CREATED        STATUS                          NAMES
df844b6611df   ghcr.io/immich-app/immich-proxy:release              "/docker-entrypoint.…"   0               1.34kB    2 days ago     Up 15 minutes                   immich_proxy
236e4eaab27b   ghcr.io/immich-app/immich-server:release             "tini -- /bin/sh sta…"   0               0B        2 days ago     Up 15 minutes                   immich_server
fd51e8b41d73   ghcr.io/immich-app/immich-machine-learning:release   "tini -- ./start.sh"     0               51.8GB    2 days ago     Up 15 minutes                   immich_machine_learning
047a88463ab1   ghcr.io/immich-app/immich-server:release             "tini -- /bin/sh sta…"   0               34.9MB    2 days ago     Up 15 minutes                   immich_microservices
965341bc2997   ghcr.io/immich-app/immich-web:release                "tini -- /bin/sh ent…"   0               0B        2 days ago     Up 15 minutes                   immich_web
bb70d2b0ff1f   redis:6.2-alpine                                     "docker-entrypoint.s…"   1               0B        2 days ago     Up 15 minutes                   immich_redis
bc1d6851854c   postgres:14-alpine                                   "docker-entrypoint.s…"   0               63B       2 days ago     Up 15 minutes                   immich_postgres
5f36c355f926   typesense/typesense:0.24.1                           "/opt/typesense-serv…"   0               0B        2 days ago     Up 15 minutes                   immich_typesense
d3529ff457c7   ghcr.io/blakeblackshear/frigate:stable               "/init"                  0               316kB     4 months ago   Up 4 days                       frigate
3bceeef4a801   exadel/compreface-fe:1.1.0                           "/docker-entrypoint.…"   0               2.39kB    6 months ago   Up 4 days                       compreface-ui
b4acfdf9bed6   exadel/compreface-admin:1.1.0                        "sh -c 'java $ADMIN_…"   0               32.8kB    6 months ago   Up 4 days                       compreface-admin
7d51d9cc9274   exadel/compreface-api:1.1.0                          "sh -c 'java $API_JA…"   0               253MB     6 months ago   Up 4 days                       compreface-api
6a2daa7ea44a   exadel/compreface-core:1.1.0                         "uwsgi --ini uwsgi.i…"   0               0B        6 months ago   Up 4 days                       compreface-core
e9c448f08f0d   exadel/compreface-postgres-db:1.1.0                  "docker-entrypoint.s…"   1               0B        6 months ago   Restarting (1) 23 seconds ago   compreface-postgres-db
bf65a5dee95e   jakowenko/double-take                                "/bin/bash ./entrypo…"   1               16.1kB    6 months ago   Up 4 days                       double-take

Local Volumes space usage:

VOLUME NAME                                                        LINKS     SIZE
45d53d4b6b9ff2f28ce866f542e652e57603d23cad6ce73c3ced076a4fb08e20   0         1.54kB
immich_model-cache                                                 0         1.005GB
915b9e10c271abfc78b81be6e5c44fc390437a0dc7384e18a5b16fff4a0b25b4   0         659.1kB
b97ef4d1ef972d1ac075a02ff7a989cb63097e5920ef72eda8d5e4d6d704d048   0         1.801kB
immich_pgdata                                                      0         77.68MB
immich_tsdata                                                      0         66.06MB
e30619b389888720ca5a91c7f791ad5f74c97743d3359565afe91cc0c3f0c8dd   0         648.3kB
d26ba5e384d78a17592a2259c8c48bc57d01f7263bcdfe6f714db8078374cd13   0         904B
1fa2ee8f30c9868a26c4427a09eddcca4161547602d4e7e5b4f364e082f2969a   0         904B
compreface_postgres-data                                           1         197.5MB
c50e00b688e6af63b642c0fc43a8891644050bac27b0c978333daaed8c3cf1b3   0         1.666kB
b65aec6e3bf3032dca29055d095f019d001dead5ef48ccc6a51059bde9cd00bb   0         904B
528ebd5a2bf61b444f43d3dbfd7abd67d27a9bb7091ed6c3f6e0a26d4109662f   1         6.631MB
doubletake_double-take                                             1         443.4MB

Build cache usage: 0B

CACHE ID   CACHE TYPE   SIZE      CREATED   LAST USED   USAGE     SHARED
tom@frigate:/media/photos-usb$ df --human-readable --local --total --print-type --exclude-type=tmpfs --exclude-type=devtmpfs | (sed --unbuffered 1q;sort --key 1)
Filesystem                        Type  Size  Used Avail Use% Mounted on
/dev/mapper/ubuntu--vg-ubuntu--lv ext4   98G   95G     0 100% /
/dev/sda1                         vfat  1.1G  6.1M  1.1G   1% /boot/efi
/dev/sda2                         ext4  2.0G  252M  1.6G  14% /boot
/dev/sdb1                         ext4  1.8T  1.4T  408G  77% /media/data
/dev/sdc1                         ext4  3.6T  176G  3.3T   6% /media/photos-usb
total                             -     5.5T  1.6T  3.7T  31% -
tom@frigate:/media/photos-usb$ df
Filesystem                         1K-blocks       Used  Available Use% Mounted on
tmpfs                                1620868       2716    1618152   1% /run
/dev/mapper/ubuntu--vg-ubuntu--lv  102626232   99211264          0 100% /
tmpfs                                8104340          0    8104340   0% /dev/shm
tmpfs                                   5120          0       5120   0% /run/lock
/dev/sda2                            1992552     257852    1613460  14% /boot
/dev/sda1                            1098628       6220    1092408   1% /boot/efi
/dev/sdb1                         1921724608 1396498552  427534000  77% /media/data
/dev/sdc1                         3844550452  183919488 3465263704   6% /media/photos-usb
tmpfs                                1620868          4    1620864   1% /run/user/1000
tom@frigate:/media/photos-usb$ df
Filesystem                         1K-blocks       Used  Available Use% Mounted on
tmpfs                                1620868       2716    1618152   1% /run
/dev/mapper/ubuntu--vg-ubuntu--lv  102626232   99211376          0 100% /
tmpfs                                8104340          0    8104340   0% /dev/shm
tmpfs                                   5120          0       5120   0% /run/lock
/dev/sda2                            1992552     257852    1613460  14% /boot
/dev/sda1                            1098628       6220    1092408   1% /boot/efi
/dev/sdb1                         1921724608 1396506188  427526364  77% /media/data
/dev/sdc1                         3844550452  183943860 3465239332   6% /media/photos-usb
tmpfs                                1620868          4    1620864   1% /run/user/1000
tom@frigate:/media/photos-usb$ lsblk
NAME                      MAJ:MIN RM   SIZE RO TYPE MOUNTPOINTS
loop0                       7:0    0  63.4M  1 loop /snap/core20/1974
loop1                       7:1    0  63.5M  1 loop /snap/core20/2015
loop2                       7:2    0 111.9M  1 loop /snap/lxd/24322
loop3                       7:3    0  40.8M  1 loop /snap/snapd/20092
loop4                       7:4    0  40.9M  1 loop /snap/snapd/20290
sda                         8:0    0 223.6G  0 disk 
├─sda1                      8:1    0     1G  0 part /boot/efi
├─sda2                      8:2    0     2G  0 part /boot
└─sda3                      8:3    0 220.5G  0 part 
  └─ubuntu--vg-ubuntu--lv 253:0    0   100G  0 lvm  /
sdb                         8:16   0   1.8T  0 disk 
└─sdb1                      8:17   0   1.8T  0 part /media/data
sdc                         8:32   0   3.6T  0 disk 
└─sdc1                      8:33   0   3.6T  0 part /media/photos-usb
tom@frigate:/media/photos-usb$ sudo lvextend --resizefs -l +100%FREE ubuntu-vg/ubuntu-lv
[sudo] password for tom: 
  Size of logical volume ubuntu-vg/ubuntu-lv changed from 100.00 GiB (25600 extents) to <220.52 GiB (56452 extents).
  Logical volume ubuntu-vg/ubuntu-lv successfully resized.
resize2fs 1.46.5 (30-Dec-2021)
Filesystem at /dev/mapper/ubuntu--vg-ubuntu--lv is mounted on /; on-line resizing required
old_desc_blocks = 13, new_desc_blocks = 28
The filesystem on /dev/mapper/ubuntu--vg-ubuntu--lv is now 57806848 (4k) blocks long.

tom@frigate:/media/photos-usb$ lsblk
NAME                      MAJ:MIN RM   SIZE RO TYPE MOUNTPOINTS
loop0                       7:0    0  63.4M  1 loop /snap/core20/1974
loop1                       7:1    0  63.5M  1 loop /snap/core20/2015
loop2                       7:2    0 111.9M  1 loop /snap/lxd/24322
loop3                       7:3    0  40.8M  1 loop /snap/snapd/20092
loop4                       7:4    0  40.9M  1 loop /snap/snapd/20290
sda                         8:0    0 223.6G  0 disk 
├─sda1                      8:1    0     1G  0 part /boot/efi
├─sda2                      8:2    0     2G  0 part /boot
└─sda3                      8:3    0 220.5G  0 part 
  └─ubuntu--vg-ubuntu--lv 253:0    0 220.5G  0 lvm  /
sdb                         8:16   0   1.8T  0 disk 
└─sdb1                      8:17   0   1.8T  0 part /media/data
sdc                         8:32   0   3.6T  0 disk 
└─sdc1                      8:33   0   3.6T  0 part /media/photos-usb
tom@frigate:/media/photos-usb$ df --human-readable --local --total --print-type --exclude-type=tmpfs --exclude-type=devtmpfs | (sed --unbuffered 1q;sort --key 1)
Filesystem                        Type  Size  Used Avail Use% Mounted on
/dev/mapper/ubuntu--vg-ubuntu--lv ext4  217G   95G  113G  46% /
/dev/sda1                         vfat  1.1G  6.1M  1.1G   1% /boot/efi
/dev/sda2                         ext4  2.0G  252M  1.6G  14% /boot
/dev/sdb1                         ext4  1.8T  1.4T  408G  77% /media/data
/dev/sdc1                         ext4  3.6T  176G  3.3T   6% /media/photos-usb
total                             -     5.6T  1.6T  3.8T  30% -
tom@frigate:/media/photos-usb$ sudo reboot
Connection to 192.168.1.128 closed by remote host.
Connection to 192.168.1.128 closed.
tnys@Toms-MacBook-Pro-2 ~ % ssh -l tom 192.168.1.128
tom@192.168.1.128's password: 
Welcome to Ubuntu 22.04.3 LTS (GNU/Linux 5.15.0-88-generic x86_64)

 * Documentation:  https://help.ubuntu.com
 * Management:     https://landscape.canonical.com
 * Support:        https://ubuntu.com/advantage

  System information as of Mon Nov 13 10:34:27 PM CET 2023

  System load:                      3.04443359375
  Usage of /:                       29.1% of 97.87GB
  Memory usage:                     40%
  Swap usage:                       0%
  Temperature:                      45.0 C
  Processes:                        263
  Users logged in:                  0
  IPv4 address for br-1febe07ae84f: 172.19.0.1
  IPv4 address for br-426557c32f9a: 172.18.0.1
  IPv4 address for br-9eff467347d5: 172.20.0.1
  IPv4 address for docker0:         172.17.0.1
  IPv4 address for eno1:            192.168.1.128
  IPv6 address for eno1:            fd79:ddca:4e2d:45d8:de4a:3eff:feea:9be4

 * Strictly confined Kubernetes makes edge and IoT secure. Learn how MicroK8s
   just raised the bar for easy, resilient and secure K8s cluster deployment.

   https://ubuntu.com/engage/secure-kubernetes-at-the-edge

Expanded Security Maintenance for Applications is not enabled.

1 update can be applied immediately.
To see these additional updates run: apt list --upgradable

Enable ESM Apps to receive additional future security updates.
See https://ubuntu.com/esm or run: sudo pro status

Last login: Fri Nov 17 12:19:23 2023 from 192.168.2.1
tom@frigate:~$ df --human-readable --local --total --print-type --exclude-type=tmpfs --exclude-type=devtmpfs | (sed --unbuffered 1q;sort --key 1)
Filesystem                        Type  Size  Used Avail Use% Mounted on
/dev/mapper/ubuntu--vg-ubuntu--lv ext4  217G   95G  113G  46% /
/dev/sda1                         vfat  1.1G  6.1M  1.1G   1% /boot/efi
/dev/sda2                         ext4  2.0G  252M  1.6G  14% /boot
/dev/sdb1                         ext4  1.8T  1.3T  412G  77% /media/data
/dev/sdc1                         ext4  3.6T  175G  3.3T   6% /media/photos-usb
total                             -     5.6T  1.6T  3.8T  30% -
tom@frigate:~$ docker system df -v
Images space usage:

REPOSITORY                                   TAG       IMAGE ID       CREATED         SIZE      SHARED SIZE   UNIQUE SIZE   CONTAINERS
ghcr.io/immich-app/immich-server             release   9070d65289d4   3 days ago      1.04GB    0B            1.039GB       2
ghcr.io/immich-app/immich-machine-learning   release   f95503aade89   3 days ago      1.66GB    131.9MB       1.524GB       1
ghcr.io/immich-app/immich-web                release   2f6fa725e19d   3 days ago      279MB     182.3MB       96.75MB       1
ghcr.io/immich-app/immich-proxy              release   d0fba67722ab   4 days ago      41.4MB    0B            41.4MB        1
<none>                                       <none>    5079d97de4a7   9 days ago      1.78GB    0B            1.783GB       0
<none>                                       <none>    9c0be69a9d0d   9 days ago      1.66GB    131.9MB       1.524GB       0
<none>                                       <none>    774a2ce99c19   9 days ago      242MB     182.3MB       59.94MB       0
<none>                                       <none>    acab9c0daace   3 months ago    46.2MB    0B            46.15MB       0
<none>                                       <none>    b9cad9a5aff9   5 months ago    27.4MB    7.332MB       20.06MB       1
<none>                                       <none>    2e0bc99c553f   5 months ago    235MB     7.332MB       228MB         1
ghcr.io/blakeblackshear/frigate              stable    dac652c4cf36   5 months ago    1.73GB    0B            1.726GB       1
<none>                                       <none>    de9eadc78acf   7 months ago    799MB     0B            799.1MB       1
exadel/compreface-core                       1.1.0     5290baadf481   8 months ago    3.9GB     0B            3.902GB       1
exadel/compreface-fe                         1.1.0     17009d953414   8 months ago    137MB     0B            137.4MB       1
exadel/compreface-admin                      1.1.0     e87cbdfceac1   8 months ago    275MB     204.5MB       70.42MB       1
exadel/compreface-api                        1.1.0     5a43c73defd1   8 months ago    361MB     204.5MB       156.5MB       1
exadel/compreface-postgres-db                1.1.0     ac2bc098a670   8 months ago    293MB     0B            293.3MB       1
jakowenko/double-take                        latest    0e6b4a512765   12 months ago   1.07GB    0B            1.069GB       1

Containers space usage:

CONTAINER ID   IMAGE                                                COMMAND                  LOCAL VOLUMES   SIZE      CREATED        STATUS         NAMES
df844b6611df   ghcr.io/immich-app/immich-proxy:release              "/docker-entrypoint.…"   0               1.34kB    2 days ago     Up 4 minutes   immich_proxy
236e4eaab27b   ghcr.io/immich-app/immich-server:release             "tini -- /bin/sh sta…"   0               0B        2 days ago     Up 4 minutes   immich_server
fd51e8b41d73   ghcr.io/immich-app/immich-machine-learning:release   "tini -- ./start.sh"     0               51.8GB    2 days ago     Up 4 minutes   immich_machine_learning
047a88463ab1   ghcr.io/immich-app/immich-server:release             "tini -- /bin/sh sta…"   0               34.9MB    2 days ago     Up 4 minutes   immich_microservices
965341bc2997   ghcr.io/immich-app/immich-web:release                "tini -- /bin/sh ent…"   0               0B        2 days ago     Up 4 minutes   immich_web
bb70d2b0ff1f   redis:6.2-alpine                                     "docker-entrypoint.s…"   1               0B        2 days ago     Up 4 minutes   immich_redis
bc1d6851854c   postgres:14-alpine                                   "docker-entrypoint.s…"   0               63B       2 days ago     Up 4 minutes   immich_postgres
5f36c355f926   typesense/typesense:0.24.1                           "/opt/typesense-serv…"   0               0B        2 days ago     Up 4 minutes   immich_typesense
d3529ff457c7   ghcr.io/blakeblackshear/frigate:stable               "/init"                  0               316kB     4 months ago   Up 4 minutes   frigate
3bceeef4a801   exadel/compreface-fe:1.1.0                           "/docker-entrypoint.…"   0               2.39kB    6 months ago   Up 4 minutes   compreface-ui
b4acfdf9bed6   exadel/compreface-admin:1.1.0                        "sh -c 'java $ADMIN_…"   0               65.5kB    6 months ago   Up 4 minutes   compreface-admin
7d51d9cc9274   exadel/compreface-api:1.1.0                          "sh -c 'java $API_JA…"   0               253MB     6 months ago   Up 4 minutes   compreface-api
6a2daa7ea44a   exadel/compreface-core:1.1.0                         "uwsgi --ini uwsgi.i…"   0               0B        6 months ago   Up 4 minutes   compreface-core
e9c448f08f0d   exadel/compreface-postgres-db:1.1.0                  "docker-entrypoint.s…"   1               63B       6 months ago   Up 4 minutes   compreface-postgres-db
bf65a5dee95e   jakowenko/double-take                                "/bin/bash ./entrypo…"   1               16.1kB    6 months ago   Up 4 minutes   double-take

Local Volumes space usage:

VOLUME NAME                                                        LINKS     SIZE
1fa2ee8f30c9868a26c4427a09eddcca4161547602d4e7e5b4f364e082f2969a   0         904B
528ebd5a2bf61b444f43d3dbfd7abd67d27a9bb7091ed6c3f6e0a26d4109662f   1         6.79MB
e30619b389888720ca5a91c7f791ad5f74c97743d3359565afe91cc0c3f0c8dd   0         648.3kB
doubletake_double-take                                             1         443.4MB
immich_pgdata                                                      0         77.68MB
45d53d4b6b9ff2f28ce866f542e652e57603d23cad6ce73c3ced076a4fb08e20   0         1.54kB
915b9e10c271abfc78b81be6e5c44fc390437a0dc7384e18a5b16fff4a0b25b4   0         659.1kB
compreface_postgres-data                                           1         197.6MB
immich_model-cache                                                 0         1.005GB
immich_tsdata                                                      0         66.06MB
b65aec6e3bf3032dca29055d095f019d001dead5ef48ccc6a51059bde9cd00bb   0         904B
b97ef4d1ef972d1ac075a02ff7a989cb63097e5920ef72eda8d5e4d6d704d048   0         1.801kB
c50e00b688e6af63b642c0fc43a8891644050bac27b0c978333daaed8c3cf1b3   0         1.666kB
d26ba5e384d78a17592a2259c8c48bc57d01f7263bcdfe6f714db8078374cd13   0         904B

Build cache usage: 0B

CACHE ID   CACHE TYPE   SIZE      CREATED   LAST USED   USAGE     SHARED
tom@frigate:~$ cd immich/
tom@frigate:~/immich$ pico docker-compose.yml 

  GNU nano 6.2                                                                                    docker-compose.yml                                                                                             
  immich-machine-learning:
    container_name: immich_machine_learning
    image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}
    volumes:
      - /media/photos-usb/immich-model-cache:/cache
    env_file:
      - .env
    restart: always

  immich-web:
    container_name: immich_web
    image: ghcr.io/immich-app/immich-web:${IMMICH_VERSION:-release}
    env_file:
      - .env
    restart: always

  typesense:
    container_name: immich_typesense
    image: typesense/typesense:0.24.1@sha256:9bcff2b829f12074426ca044b56160ca9d777a0c488303469143dd9f8259d4dd
    environment:
      - TYPESENSE_API_KEY=${TYPESENSE_API_KEY}
      - TYPESENSE_DATA_DIR=/data
      # remove this to get debug messages
      - GLOG_minloglevel=1
    volumes:
      - /media/photos-usb/immich-tsdata:/data
    restart: always

  redis:
    container_name: immich_redis
    image: redis:6.2-alpine@sha256:70a7a5b641117670beae0d80658430853896b5ef269ccf00d1827427e3263fa3
    restart: always

  database:
    container_name: immich_postgres
    image: postgres:14-alpine@sha256:28407a9961e76f2d285dc6991e8e48893503cc3836a4755bbc2d40bcc272a441
    env_file:
      - .env
    environment:
      POSTGRES_PASSWORD: ${DB_PASSWORD}
      POSTGRES_USER: ${DB_USERNAME}
      POSTGRES_DB: ${DB_DATABASE_NAME}
    volumes:
      - /media/photos-usb/immich-pgdata:/var/lib/postgresql/data
    restart: always

  immich-proxy:
    container_name: immich_proxy
    image: ghcr.io/immich-app/immich-proxy:${IMMICH_VERSION:-release}
    ports:
      - 2283:8080
    depends_on:
      - immich-server
      - immich-web
    restart: always

Your .env content

# You can find documentation for all the supported env variables at https://immich.app/docs/install/environment-variables

# The location where your uploaded files are stored
UPLOAD_LOCATION=./library

# The Immich version to use. You can pin this to a specific version like "v1.71.0"
IMMICH_VERSION=release

# Connection secrets for postgres and typesense. You should change these to random passwords
TYPESENSE_API_KEY=some-random-text
DB_PASSWORD=postgres

# The values below this line do not need to be changed
###################################################################################
DB_HOSTNAME=immich_postgres
DB_USERNAME=postgres
DB_DATABASE_NAME=immich

REDIS_HOSTNAME=immich_redis

Reproduction steps

1. Configure an external path for user
2. Configure an external library
3. Scan external library

Additional information

No response

[mertalev]

Oh wow. The container should normally save everything under the model cache volume at /cache, so it's strange to see this.

If you haven't deleted the container, would you be able to inspect where all this disk usage is coming from? /tmp, ~/ and /usr/src/app are the first places I'd check.

[tnys]

I checked disk usage in the container and these are the results:

root@fd51e8b41d73:/# du -sk /usr
132168  /usr
root@fd51e8b41d73:/# du -sk /cache
2255776 /cache
root@fd51e8b41d73:/# du -sk /tmp
51619696    /tmp
root@fd51e8b41d73:/# du -sk ~/
60  /root/
root@fd51e8b41d73:/# du -sk /usr/src/app
84  /usr/src/app

so it seems the tmp folder seems to be the one causing the issue.

[mertalev]

Hmm, my first thought was that model files are downloaded to /tmp, and interrupted downloads led to more files being downloaded and not getting cleaned up. But it would take quite a few retries and large models for that to add up to over 50gb, implausible given your model cache volume is only 1gb.

Based on the library size, my guess is that requests are being spooled to /tmp and not getting cleaned up.

Two questions: How big are the JPEG files in your thumbs folder? Spooling should normally only happen if the images are 16MiB or larger, which could maybe happen if you set JPEG resolution to 4K and quality to 100. Comparatively, how big are the files in /tmp?