search

nextcloud / nextcloudpi

📦 Build code for NextcloudPi: Raspberry Pi, Odroid, Rock64, curl installer...
https://nextcloudpi.com
2.56k stars 297 forks source link

Unable to restore NCP instance backup with ncp-restore #1883

Closed OfficialMuffin closed 20 hours ago

OfficialMuffin commented 7 months ago

On a fresh installation of v1.53.1, I am trying to recover my nextcloudpi instance but I run into an error:

[ nc-restore ] (Wed Mar 13 19:53:22 GMT 2024)
check free space...
extracting backup file /home/nick/nextcloud-bkp_20240301_1709251203.tar.gz...
restore files...
DATA CONFLICT! Your old '/var/www/nextcloud/data' directory can be found in '/var/www/nextcloud/.data_2024-03-13T1710359621' after the restore script is done. The new '/var/www/nextcloud/data' directory will be restored from the backup. You can manually merge these directories with this command (run nc-fix-permissions and nc-scan afterwards): cp -rn '/var/www/nextcloud/.data_2024-03-13T1710359621/'* '/var/www/nextcloud/.data_2024-03-13T1710359621/'.[!.]* '/var/www/nextcloud/data/'
Restoring old '/var/www/nextcloud/data' to '/var/www/nextcloud/.data_2024-03-13T1710359621'...
restore database...
ERROR 1062 (23000) at line 2638: Duplicate entry '2-f98fa29f95a6e9ba8c7a1bdfd8054a51' for key 'fs_storage_path_hash'
Error restoring nextcloud database
Cleanup...

System information

NextcloudPi diagnostics ``` Nextcloud or one of the apps require upgrade - only a limited number of commands are available You may use your browser or the occ upgrade command to do the upgrade grep: /etc/apache2/sites-available/nextcloud.conf: No such file or directory NextcloudPi version v1.53.1 NextcloudPi image NextcloudPi_RaspberryPi_v1.53.1.img OS Debian GNU/Linux 11. 5.15.61-v8+ (aarch64) automount no USB devices sda datadir /var/www/nextcloud/data data in SD yes data filesystem ext2/ext3 data disk usage 4.5G/110G rootfs usage 4.5G/110G swapfile /var/swap dbdir /var/lib/mysql Nextcloud check ok Nextcloud version 27.1.7.2 HTTPD service up PHP service up MariaDB service up Redis service up HPB service down Postfix service up Internet check ok Public IPv4 ***REMOVED SENSITIVE VALUE*** Public IPv6 ***REMOVED SENSITIVE VALUE*** Port 80 closed Port 443 closed IP ***REMOVED SENSITIVE VALUE*** Gateway ***REMOVED SENSITIVE VALUE*** Interface wlan0 Certificates ***REMOVED SENSITIVE VALUE*** NAT loopback no Uptime 45min ```
Nextcloud configuration ``` Nextcloud or one of the apps require upgrade - only a limited number of commands are available You may use your browser or the occ upgrade command to do the upgrade { "system": { "passwordsalt": "***REMOVED SENSITIVE VALUE***", "secret": "***REMOVED SENSITIVE VALUE***", "trusted_domains": { "0": "localhost", "7": "nextcloudpi", "5": "nextcloudpi.local", "8": "nextcloudpi.lan", "3": "next", "1": "192.168.1.130", "14": "next", }, "datadirectory": "***REMOVED SENSITIVE VALUE***", "dbtype": "mysql", "version": "27.1.6.2", "overwrite.cli.url": "https:\/\/next\/", "dbname": "***REMOVED SENSITIVE VALUE***", "dbhost": "***REMOVED SENSITIVE VALUE***", "dbport": "", "dbtableprefix": "oc_", "mysql.utf8mb4": true, "dbuser": "***REMOVED SENSITIVE VALUE***", "dbpassword": "***REMOVED SENSITIVE VALUE***", "installed": true, "instanceid": "***REMOVED SENSITIVE VALUE***", "memcache.local": "\\OC\\Memcache\\Redis", "memcache.locking": "\\OC\\Memcache\\Redis", "redis": { "host": "***REMOVED SENSITIVE VALUE***", "port": 0, "timeout": 0, "password": "***REMOVED SENSITIVE VALUE***" }, "tempdirectory": "\/var\/www\/nextcloud\/data\/tmp", "mail_smtpmode": "sendmail", "mail_smtpauthtype": "LOGIN", "preview_max_x": "2048", "preview_max_y": "2048", "jpeg_quality": "60", "overwriteprotocol": "https", "default_phone_region": "GB", "trusted_proxies": "***REMOVED SENSITIVE VALUE***", "loglevel": "2", "log_type": "file", "maintenance": true, "mail_sendmailmode": "smtp", "twofactor_enforced": "true", "twofactor_enforced_groups": [ "Users", "admin" ], "twofactor_enforced_excluded_groups": [], "mail_from_address": "***REMOVED SENSITIVE VALUE***", "mail_domain": "***REMOVED SENSITIVE VALUE***", "htaccess.RewriteBase": "\/", "logfile": "\/var\/www\/nextcloud\/data\/nextcloud.log", "data-fingerprint": "af4d54d3679aa4562196dde93e015500", "ncd_admin_settings": { "ncd_disable_bt": "1" }, "theme": "", "app_install_overwrite": [ "duplicatefinder", "keeporsweep" ] } } ```
HTTPd logs ``` [Wed Mar 13 19:42:14.999124 2024] [authnz_external:error] [pid 39514:tid 547780280704] [remote 192.168.1.176:38554] AuthExtern pwauth [/usr/sbin/pwauth]: Failed (1) for user ncp, referer: https://192.168.1.184:4443/ [Wed Mar 13 19:42:14.999249 2024] [auth_basic:error] [pid 39514:tid 547780280704] [remote 192.168.1.176:38554] AH01617: user ncp: authentication failure for "/img/loading-small.gif": Password Mismatch, referer: https://192.168.1.184:4443/ [Wed Mar 13 19:42:15.001214 2024] [authnz_external:error] [pid 39514:tid 547805507968] [remote 192.168.1.176:38554] AuthExtern pwauth [/usr/sbin/pwauth]: Failed (1) for user ncp, referer: https://192.168.1.184:4443/ [Wed Mar 13 19:42:15.001300 2024] [auth_basic:error] [pid 39514:tid 547805507968] [remote 192.168.1.176:38554] AH01617: user ncp: authentication failure for "/js/ncp.js": Password Mismatch, referer: https://192.168.1.184:4443/ [Wed Mar 13 19:42:15.017178 2024] [authnz_external:error] [pid 39514:tid 547813917056] [remote 192.168.1.176:38554] AuthExtern pwauth [/usr/sbin/pwauth]: Failed (1) for user ncp, referer: https://192.168.1.184:4443/ [Wed Mar 13 19:42:15.017261 2024] [auth_basic:error] [pid 39514:tid 547813917056] [remote 192.168.1.176:38554] AH01617: user ncp: authentication failure for "/js/minified.js": Password Mismatch, referer: https://192.168.1.184:4443/ [Wed Mar 13 19:42:15.077155 2024] [authnz_external:error] [pid 39514:tid 547788689792] [remote 192.168.1.176:38554] AuthExtern pwauth [/usr/sbin/pwauth]: Failed (1) for user ncp, referer: https://192.168.1.184:4443/ [Wed Mar 13 19:42:15.077267 2024] [auth_basic:error] [pid 39514:tid 547788689792] [remote 192.168.1.176:38554] AH01617: user ncp: authentication failure for "/img/ncp-logo.svg": Password Mismatch, referer: https://192.168.1.184:4443/ [Wed Mar 13 19:42:15.097683 2024] [authnz_external:error] [pid 39514:tid 547797098880] [remote 192.168.1.176:38554] AuthExtern pwauth [/usr/sbin/pwauth]: Failed (1) for user ncp, referer: https://192.168.1.184:4443/ [Wed Mar 13 19:42:15.097765 2024] [auth_basic:error] [pid 39514:tid 547797098880] [remote 192.168.1.176:38554] AH01617: user ncp: authentication failure for "/css/ncp.css": Password Mismatch, referer: https://192.168.1.184:4443/ [Wed Mar 13 19:42:26.870255 2024] [authnz_external:error] [pid 38918:tid 547898007936] [remote 192.168.1.176:38555] AuthExtern pwauth [/usr/sbin/pwauth]: Failed (1) for user ncp, referer: https://192.168.1.184:4443/ [Wed Mar 13 19:42:26.870373 2024] [auth_basic:error] [pid 38918:tid 547898007936] [remote 192.168.1.176:38555] AH01617: user ncp: authentication failure for "/img/ncp-logo.svg": Password Mismatch, referer: https://192.168.1.184:4443/ [Wed Mar 13 19:42:26.891878 2024] [authnz_external:error] [pid 38918:tid 547889598848] [remote 192.168.1.176:38555] AuthExtern pwauth [/usr/sbin/pwauth]: Failed (1) for user ncp, referer: https://192.168.1.184:4443/ [Wed Mar 13 19:42:26.891983 2024] [auth_basic:error] [pid 38918:tid 547889598848] [remote 192.168.1.176:38555] AH01617: user ncp: authentication failure for "/css/ncp.css": Password Mismatch, referer: https://192.168.1.184:4443/ [Wed Mar 13 19:42:26.951539 2024] [authnz_external:error] [pid 38918:tid 547923202432] [remote 192.168.1.176:38555] AuthExtern pwauth [/usr/sbin/pwauth]: Failed (1) for user ncp, referer: https://192.168.1.184:4443/ [Wed Mar 13 19:42:26.951624 2024] [auth_basic:error] [pid 38918:tid 547923202432] [remote 192.168.1.176:38555] AH01617: user ncp: authentication failure for "/js/ncp.js": Password Mismatch, referer: https://192.168.1.184:4443/ [Wed Mar 13 19:42:26.954338 2024] [authnz_external:error] [pid 38918:tid 547906417024] [remote 192.168.1.176:38555] AuthExtern pwauth [/usr/sbin/pwauth]: Failed (1) for user ncp, referer: https://192.168.1.184:4443/ [Wed Mar 13 19:42:26.954403 2024] [auth_basic:error] [pid 38918:tid 547906417024] [remote 192.168.1.176:38555] AH01617: user ncp: authentication failure for "/js/minified.js": Password Mismatch, referer: https://192.168.1.184:4443/ [Wed Mar 13 19:42:26.957166 2024] [authnz_external:error] [pid 38918:tid 547729826176] [remote 192.168.1.176:38555] AuthExtern pwauth [/usr/sbin/pwauth]: Failed (1) for user ncp, referer: https://192.168.1.184:4443/ [Wed Mar 13 19:42:26.957241 2024] [auth_basic:error] [pid 38918:tid 547729826176] [remote 192.168.1.176:38555] AH01617: user ncp: authentication failure for "/img/loading-small.gif": Password Mismatch, referer: https://192.168.1.184:4443/ ```
Database logs ``` tail: cannot open '/var/log/mysql/*.log' for reading: No such file or directory ```
Nextcloud logs ``` {"reqId":"T1EhTuG68S4gdtToxzUm","level":2,"time":"2024-03-13T19:55:01+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"27.1.6.2","data":[]} {"reqId":"ZMGwQrzPnXvrtZJ2cujC","level":2,"time":"2024-03-13T20:00:01+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"27.1.6.2","data":[]} {"reqId":"ha7iOvmX7UIVoFTrQ7LQ","level":2,"time":"2024-03-13T20:05:02+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"27.1.6.2","data":[]} {"reqId":"CzwFtwdrgyaCuSFRZ9eA","level":2,"time":"2024-03-13T20:10:01+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"27.1.6.2","data":[]} {"reqId":"TDA0fSdUEePaNvHqKx8n","level":2,"time":"2024-03-13T20:15:02+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"27.1.6.2","data":[]} {"reqId":"QXmiF2kEMZTJoxcZMh7D","level":2,"time":"2024-03-13T20:17:44+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"27.1.6.2","data":[]} {"reqId":"3SVgjppfed38K1xYs4hS","level":2,"time":"2024-03-13T20:17:46+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"27.1.6.2","data":[]} {"reqId":"VK91fN5KpSqNYcKo6jI4","level":2,"time":"2024-03-13T20:17:47+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"27.1.6.2","data":[]} {"reqId":"9zHQlHFgIsmEpj0r8MGy","level":2,"time":"2024-03-13T20:17:52+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Temporary directory /var/www/nextcloud/data/tmp is not present or writable","userAgent":"--","version":"27.1.6.2","data":[]} ```
theCalcaholic commented 20 hours ago

Sorry for the late reply. I assume you have found a solution by now. If not, you could try this:

That looks like your database wasn't really empty or you have an issue in your previous database. I'd recommend editing the backup (specifically delete line 2638 from the file nextcloud-sqlbkp_<some-numbers>.bak inside the backup file) and try if the backup succeeds after that.

I don't think it's a bug in NCP though, so I will close the ticket for now (feel free to respond though).