Running on an Unraid Server, i5 gen 12 with 16GB of Ram.
Scans a folder with 60+ Images of all types.
I can see Ram usage rising forever until it freezes my server.
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES```
Output of `docker logs CONTAINERNAME` (replace *CONTAINERNAME* with your nut container's name):
``` docker logs nut
[s6-init] making user provided files available at /var/run/s6/etc...exited 0.
[s6-init] ensuring user provided files have correct perms...exited 0.
[fix-attrs.d] applying ownership & permissions fixes...
[fix-attrs.d] done.
[cont-init.d] executing container initialization scripts...
[cont-init.d] 00-adduser: executing...
-------------------------------------
GID/UID
-------------------------------------
User uid: 99
User gid: 100
-------------------------------------
[cont-init.d] 00-adduser: exited 0.
[cont-init.d] 01-create_configs: executing...
-------------------------------------
Checking conf folder...
-------------------------------------
Downloading latest blacklist.online.txt...
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1615 100 1615 0 0 9443 0 --:--:-- --:--:-- --:--:-- 9500
keys.txt not found! Copying keys_template.txt...
'/nut/keys_template.txt' -> '/nut/conf/keys_template.txt'
Changing ownership of /nut/conf folder...
-------------------------------------
[cont-init.d] 01-create_configs: exited 0.
[cont-init.d] 02-fix-ownership: executing...
-------------------------------------
Checking ownership of /nut folder
-------------------------------------
USER_ID differs from default, adjusting ownership...
GROUP_ID differs from default, adjusting ownership...
Done.
-------------------------------------
[cont-init.d] 02-fix-ownership: exited 0.
[cont-init.d] 03-update-titledb: executing...
-------------------------------------
Updating titledb...
-------------------------------------
Updating titledb, this might take some time...
Removing blockchain.json
Removing db.bin
Removing demos.txt
Removing ranks.txt
Updating files: 100% (70/70), done.
HEAD is now at e44747b meta
hint: You have divergent branches and need to specify how to reconcile them.
hint: You can do so by running one of the following commands sometime before
hint: your next pull:
hint:
hint: git config pull.rebase false # merge (the default strategy)
hint: git config pull.rebase true # rebase
hint: git config pull.ff only # fast-forward only
hint:
hint: You can replace "git config" with "git config --global" to set a default
hint: preference for all repositories. You can also pass --rebase, --no-rebase,
hint: or --ff-only on the command line to override the configured default per
hint: invocation.
fatal: Need to specify how to reconcile divergent branches.
error: pack-objects died of signal 9
fatal: failed to run repack
Importing titledb...
loading blacklist /nut/conf/blacklist.online.txt
could not load find or load keys.txt, all crypto operations will fail. See keys_template.txt for an example of how this file should look
loaded user outerbeam
loaded user crontab
,;:;;,
;;;;;
.=', ;:;;:,
/_', "=. ';:;:;
@=:__, \,;:;:'
_(\.= ;:;;'
`"_( _/="`
`"'
downloading titledb files
could not get title id from filename, name needs to contain [titleId] : titledb/db.nza
unknown extension titledb/db.nza
loaded titledb/BG.en.json in 0.23823208804242313 seconds
loaded titledb/BR.en.json in 0.2786967830033973 seconds
loaded titledb/BR.pt.json in 0.25442978797946125 seconds
loaded titledb/CH.fr.json in 0.3129976249765605 seconds
loaded titledb/CH.de.json in 0.2833185640629381 seconds
loaded titledb/CH.it.json in 0.20778160297777504 seconds
loaded titledb/CY.en.json in 0.32592927501536906 seconds
loaded titledb/EE.en.json in 0.217059409013018 seconds
loaded titledb/HR.en.json in 0.3280035461066291 seconds
loaded titledb/IE.en.json in 0.20759940205607563 seconds
loaded titledb/LT.en.json in 0.3745210620108992 seconds
loaded titledb/LU.fr.json in 0.22442532505374402 seconds
loaded titledb/LU.de.json in 0.2370595260290429 seconds
loaded titledb/LV.en.json in 0.22769209509715438 seconds
loaded titledb/MT.en.json in 0.3804416839266196 seconds
loaded titledb/RO.en.json in 0.24732681398745626 seconds
loaded titledb/SI.en.json in 0.20107219193596393 seconds
loaded titledb/SK.en.json in 0.21566999901551753 seconds
loaded titledb/CO.en.json in 0.41167985007632524 seconds
loaded titledb/CO.es.json in 0.1925435570301488 seconds
loaded titledb/AR.en.json in 0.1786764229182154 seconds
loaded titledb/AR.es.json in 0.22418079292401671 seconds
loaded titledb/CL.en.json in 0.15865069394931197 seconds
loaded titledb/CL.es.json in 0.5119115631096065 seconds
loaded titledb/PE.en.json in 0.2225921950303018 seconds
loaded titledb/PE.es.json in 0.06662097200751305 seconds
loaded titledb/KR.ko.json in 0.2605207309825346 seconds
loaded titledb/HK.zh.json in 0.21654023602604866 seconds
loaded titledb/CN.zh.json in 0.001914230058901012 seconds
loaded titledb/NZ.en.json in 0.3120957480277866 seconds
loaded titledb/AT.de.json in 0.26717358792666346 seconds
loaded titledb/BE.fr.json in 0.7716057630022988 seconds
loaded titledb/BE.nl.json in 0.330633657053113 seconds
loaded titledb/CZ.en.json in 0.36277278105262667 seconds
loaded titledb/DK.en.json in 0.33124052197672427 seconds
loaded titledb/ES.es.json in 0.8273201079573482 seconds
loaded titledb/FI.en.json in 0.3281622489448637 seconds
loaded titledb/GR.en.json in 0.2636249699862674 seconds
loaded titledb/HU.en.json in 0.4083807209972292 seconds
loaded titledb/NL.nl.json in 0.05970189091749489 seconds
loaded titledb/NO.en.json in 0.2530761630041525 seconds
loaded titledb/PL.en.json in 0.06725593900773674 seconds
loaded titledb/PT.pt.json in 0.26215814298484474 seconds
loaded titledb/RU.ru.json in 0.4702012409688905 seconds
loaded titledb/ZA.en.json in 0.9067188119515777 seconds
loaded titledb/SE.en.json in 0.21341966302134097 seconds
loaded titledb/MX.en.json in 0.3219240440521389 seconds
loaded titledb/MX.es.json in 0.3498591741081327 seconds
loaded titledb/IT.it.json in 0.24887360201682895 seconds
loaded titledb/CA.en.json in 0.3427913310006261 seconds
loaded titledb/CA.fr.json in 0.3960959539981559 seconds
loaded titledb/FR.fr.json in 0.3958309319568798 seconds
loaded titledb/DE.de.json in 1.0443688619416207 seconds
loaded titledb/JP.ja.json in 0.3880105720600113 seconds
loaded titledb/AU.en.json in 0.3048323739785701 seconds
loaded titledb/GB.en.json in 0.3167701020138338 seconds
loaded titledb/US.en.json in 0.3143638380570337 seconds
loaded titledb/US.es.json in 0.321275805006735 seconds
loaded titledb/demos.txt in 0.019343390013091266 seconds
loaded titledb/ranks.txt in 0.31630631897132844 seconds
loaded titledb/versions.txt in 0.5123124519595876 seconds
loaded titledb/titles.json in 0.5696608698926866 seconds
loaded file list in 0.00015079102013260126 seconds
loaded titledb/demos.txt in 0.014075087034143507 seconds
loaded titledb/ranks.txt in 0.2646115570096299 seconds
loaded titledb/versions.txt in 0.3857278940267861 seconds
loaded titledb/demos.txt in 0.014465661020949483 seconds
loaded titledb/ranks.txt in 0.2933268820634112 seconds
loaded titledb/versions.txt in 0.37920851202216 seconds
nut exception: 0
Done.
-------------------------------------
[cont-init.d] 03-update-titledb: exited 0.
[cont-init.d] 04-update-crontabs: executing...
-------------------------------------
Updating /etc/crontabs/root...
-------------------------------------
Checking if there is a crontab user in your users.conf...
Found crontab user!
Found schedule for command scan: 0/30 * * * *
Added scan schedule to /etc/crontabs/root...
Done.
-------------------------------------
[cont-init.d] 04-update-crontabs: exited 0.
[cont-init.d] done.
[services.d] starting services
[services.d] done.
loading blacklist /nut/conf/blacklist.online.txt
could not load find or load keys.txt, all crypto operations will fail. See keys_template.txt for an example of how this file should look
loaded user outerbeam
loaded user crontab
,;:;;,
;;;;;
.=', ;:;;:,
/_', "=. ';:;:;
@=:__, \,;:;:'
_(\.= ;:;;'
`"_( _/="`
`"'
loaded titledb/titles.json in 0.6121993530541658 seconds
loaded file list in 5.36689767614007e-05 seconds
scanning .
scanning Animal Crossing New Horizons [DLC Nook Inc silk rug] [01006F800232712D][v0].nsp
scanning Animal Crossing New Horizons [DLC Special Order Ticket ACPC Tie-in Campaign] [01006F800232712C][v0].nsp
scanning Animal Crossing New Horizons [DLC Special Order Ticket Pocket Camp tie-in campaign] [01006F800232712C][v0].nsp```
**### Had to delete 590 lines with DLCs...**
```scanning The Legend of Zelda Skyward Sword HD [01002DA013484000][v0] (7.07 GB).nsp
Sat Dec 16 12:50:28 2023 Server Starts - 0.0.0.0:9000
routing to getScan
scanning .
127.0.0.1 - - [16/Dec/2023 13:00:00] "GET /api/scan HTTP/1.1" 200 -
[NUT API Script] Executing scan successful!```
Output of `id` (you should be logged in with the user that owns your games directory):
```on server :
root@Server:~# id
uid=0(root) gid=0(root) groups=0(root)
in the container :
/nut # id
uid=0(root) gid=0(root) groups=0(root),1(bin),2(daemon),3(sys),4(adm),6(disk),10(wheel),11(floppy),20(dialout),26(tape),27(video)
Output of docker exec --user nut CONTAINERNAME id (replace CONTAINERNAME with your nut container's name):
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1615 100 1615 0 0 8485 0 --:--:-- --:--:-- --:--:-- 8500
Updating files: 100% (70/70), done.
hint: You have divergent branches and need to specify how to reconcile them.
hint: You can do so by running one of the following commands sometime before
hint: your next pull:
hint:
hint: git config pull.rebase false # merge (the default strategy)
hint: git config pull.rebase true # rebase
hint: git config pull.ff only # fast-forward only
hint:
hint: You can replace "git config" with "git config --global" to set a default
hint: preference for all repositories. You can also pass --rebase, --no-rebase,
hint: or --ff-only on the command line to override the configured default per
hint: invocation.
fatal: Need to specify how to reconcile divergent branches.
scanning Luigi's Mansion 3 [0100DCA0064A6000] [v327680] (1G+1U+2D).nsp
scanning Metroid Dread [010093801237C000] [v262144] (1G+1U).nsp
scanning Super Mario 3D World Bowsers Fury [010028600EBDA000][v0] (2.87 GB).nsp
scanning Super Smash Bros Ultimate [01006A800016E800][v1769472] (3.66 GB).nsp
scanning The Legend of Zelda Skyward Sword HD [01002DA013484000][v0] (7.07 GB).nsp
Sat Dec 16 12:50:28 2023 Server Starts - 0.0.0.0:9000
routing to getScan
scanning .
[NUT API Script] Executing scan successful!
[cont-finish.d] executing container finish scripts...
[cont-finish.d] done.
[s6-finish] waiting for services.
[s6-finish] sending all processes the TERM signal.
[s6-finish] sending all processes the KILL signal and exiting.
[s6-init] making user provided files available at /var/run/s6/etc...exited 0.
[s6-init] ensuring user provided files have correct perms...exited 0.
[fix-attrs.d] applying ownership & permissions fixes...
[fix-attrs.d] done.
[cont-init.d] executing container initialization scripts...
[cont-init.d] 00-adduser: executing...
usermod: no changes
-------------------------------------
GID/UID
-------------------------------------
User uid: 99
User gid: 100
-------------------------------------
[cont-init.d] 00-adduser: exited 0.
[cont-init.d] 01-create_configs: executing...
-------------------------------------
Checking conf folder...
-------------------------------------
Downloading latest blacklist.online.txt...
keys.txt not found! Copying keys_template.txt...
'/nut/keys_template.txt' -> '/nut/conf/keys_template.txt'
Changing ownership of /nut/conf folder...
-------------------------------------
[cont-init.d] 01-create_configs: exited 0.
[cont-init.d] 02-fix-ownership: executing...
-------------------------------------
Checking ownership of /nut folder
-------------------------------------
USER_ID differs from default, adjusting ownership...
GROUP_ID differs from default, adjusting ownership...
Done.
-------------------------------------
[cont-init.d] 02-fix-ownership: exited 0.
[cont-init.d] 03-update-titledb: executing...
-------------------------------------
Updating titledb...
-------------------------------------
Updating titledb, this might take some time...
Removing blockchain.json
Removing db.bin
Removing demos.txt
Removing files.json
Removing ranks.txt
Removing titles.json
HEAD is now at e44747b meta
When limiting RAM to 2G, I get :
Updating titledb, this might take some time...
HEAD is now at e44747b meta
error: pack-objects died of signal 9
fatal: failed to run repack
Importing titledb...
loading blacklist /nut/conf/blacklist.online.txt
could not load find or load keys.txt, all crypto operations will fail. See keys_template.txt for an example of how this file should look
loaded user outerbeam
loaded user crontab
,;:;;,
;;;;;
.=', ;:;;:,
/_', "=. ';:;:;
@=:__, \,;:;:'
_(\.= ;:;;'
`"_( _/="`
`"'
downloading titledb files
Killed
Done.
-------------------------------------
[cont-init.d] 03-update-titledb: exited 0.
[cont-init.d] 04-update-crontabs: executing...
-------------------------------------
Updating /etc/crontabs/root...
-------------------------------------
Checking if there is a crontab user in your users.conf...
Found crontab user!
Found schedule for command scan: 0/30 * * * *
Added scan schedule to /etc/crontabs/root...
Done.
-------------------------------------
[cont-init.d] 04-update-crontabs: exited 0.
[cont-init.d] done.
[services.d] starting services
[services.d] done.
loading blacklist /nut/conf/blacklist.online.txt
could not load find or load keys.txt, all crypto operations will fail. See keys_template.txt for an example of how this file should look
loaded user outerbeam
loaded user crontab
,;:;;,
;;;;;
.=', ;:;;:,
/_', "=. ';:;:;
@=:__, \,;:;:'
_(\.= ;:;;'
`"_( _/="`
`"'
downloading titledb files
./run: line 8: 329 Killed s6-setuidgid nut python /nut/nut.py --scan --server
loading blacklist /nut/conf/blacklist.online.txt
could not load find or load keys.txt, all crypto operations will fail. See keys_template.txt for an example of how this file should look
loaded user outerbeam
loaded user crontab
,;:;;,
;;;;;
.=', ;:;;:,
/_', "=. ';:;:;
@=:__, \,;:;:'
_(\.= ;:;;'
`"_( _/="`
`"'
downloading titledb files
I have read and followed all troubleshooting steps from the README.md?
Yes
Running on an Unraid Server, i5 gen 12 with 16GB of Ram. Scans a folder with 60+ Images of all types. I can see Ram usage rising forever until it freezes my server.
Output of
docker version
:Output of
docker ps -a -f "ancestor=shawly/nut"
:Output of
docker exec --user nut CONTAINERNAME id
(replace CONTAINERNAME with your nut container's name):Output of
ls -l /path/to/your/games/folder
:Output of
docker exec CONTAINERNAME ls -l /nut/titles
(replace CONTAINERNAME with your nut container's name):My docker run command or my docker-compose.yml:
/usr/local/emhttp/plugins/dynamix.docker.manager/scripts/docker create --name='nut' --net='bridge' -e TZ="America/Los_Angeles" -e HOST_OS="Unraid" -e HOST_HOSTNAME="Server" -e HOST_CONTAINERNAME="nut" -e 'FIX_OWNERSHIP'='true' -e 'TITLEDB_UPDATE'='true' -e 'TITLEDB_URL'='https://github.com/blawar/titledb' -e 'TITLEDB_REGION'='US' -e 'TITLEDB_LANGUAGE'='en' -e 'NUT_API_SCHEDULES'='[{"scan": "0/30 * * * *"}]' -e 'USER_ID'='99' -e 'GROUP_ID'='100' -e 'UMASK'='022' -l net.unraid.docker.managed=dockerman -l net.unraid.docker.webui='http://[IP]:[PORT:9000]' -l net.unraid.docker.icon='https://raw.githubusercontent.com/A75G/docker-templates/master/templates/icons/nut.png' -l 'traefik.http.services.nut.loadbalancer.server.port'='9000' -l 'traefik.enable'='true' -l 'traefik.http.routers.nut.rule'='Host(`nut.outerbeam.com`)' -l 'traefik.http.routers.nut.entryPoints'='http' -p '9000:9000/tcp' -v '/mnt/user/APPLICATIONS/GAMES/SWITCH/':'/nut/titles':'rw' -v '/mnt/user/APPLICATIONS/GAMES/SWITCH HOMEBREWS/NUT/CONF':'/nut/conf':'rw' -v '/mnt/user/APPLICATIONS/GAMES/SWITCH HOMEBREWS/NUT/NSP_OUT':'/nut/_NSPOUT':'rw' -v '/mnt/user/APPLICATIONS/GAMES/SWITCH HOMEBREWS/NUT/DB':'/nut/titledb':'rw' --memory=6G 'shawly/nut:edge'
Here's the visible log after server freeze :
When limiting RAM to 2G, I get :