nextcloud / previewgenerator

Nextcloud app to do preview generation in the background.
https://apps.nextcloud.com/apps/previewgenerator
GNU Affero General Public License v3.0
455 stars 57 forks source link

Serialisation error #277

Closed dgedgedge closed 2 years ago

dgedgedge commented 2 years ago

While running : /usr/bin/php ./occ preview:generate-all I got the following error :

2021-12-23T02:48:53+01:00 In ExceptionConverter.php line 37:
2021-12-23T02:48:53+01:00                                                                                
2021-12-23T02:48:53+01:00   An exception occurred while executing a query: SQLSTATE[40001]: Serializati  
2021-12-23T02:48:53+01:00   on failure: 1213 Deadlock found when trying to get lock; try restarting tra  
2021-12-23T02:48:53+01:00   nsaction                                                                     
2021-12-23T02:48:53+01:00                                                                                
2021-12-23T02:48:53+01:00 
2021-12-23T02:48:53+01:00 In Exception.php line 26:
2021-12-23T02:48:53+01:00                                                                                
2021-12-23T02:48:53+01:00   SQLSTATE[40001]: Serialization failure: 1213 Deadlock found when trying to   
2021-12-23T02:48:53+01:00   get lock; try restarting transaction                                         
2021-12-23T02:48:53+01:00                                                                                
2021-12-23T02:48:53+01:00 
2021-12-23T02:48:53+01:00 In Statement.php line 92:
2021-12-23T02:48:53+01:00                                                                                
2021-12-23T02:48:53+01:00   SQLSTATE[40001]: Serialization failure: 1213 Deadlock found when trying to   
2021-12-23T02:48:53+01:00   get lock; try restarting transaction                                         
2021-12-23T02:48:53+01:00                                                                                
2021-12-23T02:48:53+01:00 
2021-12-23T02:48:53+01:00 preview:generate-all [-p|--path [PATH]] [--] [<user_id>...]

I suspect a deadlock with the following command : /usr/bin/php -f /var/www/nextcloud/cron.php

Should I stop calling the later in the cron while running the preview generation ?

Context:

Server configuration detail

Operating system: Linux 4.19.0-18-amd64 #1 SMP Debian 4.19.208-1 (2021-09-29) x86_64

Webserver: Apache (apache2handler)

Database: mysql 10.3.31

PHP version: 7.3.31-1~deb10u1

Modules loaded: Core, date, libxml, openssl, pcre, zlib, filter, hash, Reflection, SPL, sodium, session, standard, apache2handler, mysqlnd, PDO, xml, apcu, bcmath, bz2, calendar, ctype, curl, dom, mbstring, fileinfo, ftp, gd, gettext, gmp, iconv, igbinary, imagick, intl, json, exif, msgpack, mysqli, pdo_mysql, apc, posix, readline, redis, shmop, SimpleXML, sockets, sysvmsg, sysvsem, sysvshm, tokenizer, wddx, xmlreader, xmlwriter, xsl, zip, Phar, memcached, Zend OPcache

Nextcloud version: 22.2.3 - 22.2.3.0

Updated from an older Nextcloud.

Where did you install Nextcloud from: Upgraded release by release from release 19.x or earlier.

Signing status Array ( )
List of activated apps Enabled: - accessibility: 1.8.0 - activity: 2.15.0 - admin_audit: 1.12.0 - analytics: 4.0.2 - announcementcenter: 6.1.1 - bruteforcesettings: 2.3.0 - calendar: 3.0.3 - carnet: 0.24.2 - checksum: 1.1.3 - circles: 22.1.1 - cloud_federation_api: 1.5.0 - collectives: 0.17.22 - comments: 1.12.0 - contacts: 4.0.7 - contactsinteraction: 1.3.0 - cookbook: 0.9.8 - dashboard: 7.2.0 - dav: 1.19.0 - deck: 1.5.5 - documentserver_community: 0.1.11 - drawio: 1.0.2 - federatedfilesharing: 1.12.0 - files: 1.17.0 - files_external: 1.13.0 - files_markdown: 2.3.5 - files_mindmap: 0.0.25 - files_pdfviewer: 2.3.1 - files_rightclick: 1.1.0 - files_sharing: 1.14.0 - files_trashbin: 1.12.0 - files_versions: 1.15.0 - files_videoplayer: 1.11.0 - firstrunwizard: 2.11.0 - geoblocker: 0.5.2 - keeweb: 0.6.8 - logreader: 2.7.0 - lookup_server_connector: 1.10.0 - mail: 1.11.4 - maps: 0.1.10 - music: 1.5.0 - nextcloud_announcements: 1.11.0 - notes: 4.2.0 - notifications: 2.10.1 - oauth2: 1.10.0 - onlyoffice: 7.2.1 - password_policy: 1.12.0 - photos: 1.4.0 - previewgenerator: 3.4.1 - privacy: 1.6.0 - provisioning_api: 1.12.0 - recommendations: 1.1.0 - serverinfo: 1.12.0 - settings: 1.4.0 - sharebymail: 1.12.0 - spreed: 12.2.2 - support: 1.5.0 - survey_client: 1.10.0 - systemtags: 1.12.0 - tasks: 0.14.2 - text: 3.3.0 - theming: 1.13.0 - twofactor_backupcodes: 1.11.0 - updatenotification: 1.12.0 - user_status: 1.2.0 - viewer: 1.6.0 - weather_status: 1.2.0 - workflowengine: 2.4.0 Disabled: - encryption - federation - files_texteditor - user_ldap
Configuration (config/config.php) { "instanceid": "***REMOVED SENSITIVE VALUE***", "passwordsalt": "***REMOVED SENSITIVE VALUE***", "secret": "***REMOVED SENSITIVE VALUE***", "trusted_domains": [ "***REMOVED SENSITIVE VALUE***", ], "datadirectory": "***REMOVED SENSITIVE VALUE***", "overwrite.cli.url": "***REMOVED SENSITIVE VALUE***", "dbtype": "mysql", "version": "22.2.3.0", "dbname": "***REMOVED SENSITIVE VALUE***", "dbhost": "***REMOVED SENSITIVE VALUE***", "dbport": "", "dbtableprefix": "oc_", "dbuser": "***REMOVED SENSITIVE VALUE***", "dbpassword": "***REMOVED SENSITIVE VALUE***", "loglevel": 2, "logtimezone": "Europe\/Paris", "logfile": "\/var\/log\/nextcloud.log", "log_rotate_size": 0, "installed": true, "memcache.local": "\\OC\\Memcache\\APCu", "share_folder": "\/SharedWithMe", "mail_from_address": "***REMOVED SENSITIVE VALUE***", "mail_smtpmode": "smtp", "mail_domain": "***REMOVED SENSITIVE VALUE***", "mail_smtphost": "***REMOVED SENSITIVE VALUE***", "maintenance": false, "theme": "", "default_phone_region": "FR", "updater.release.channel": "stable", "mail_smtpauth": 1, "mail_sendmailmode": "smtp", "mail_smtpauthtype": "LOGIN", "mail_smtpname": "***REMOVED SENSITIVE VALUE***", "mail_smtppassword": "***REMOVED SENSITIVE VALUE***", "mysql.utf8mb4": true, "trashbin_retention_obligation": "auto, 100", "has_rebuilt_cache": true, "app_install_overwrite": [ "files_reader" ] }

External storages: yes

External storage configuration No mounts configured

Encryption: no

User-backends:

OC\User\Database

Talk configuration:

STUN servers

"REMOVED SENSITIVE VALUE":3478

TURN servers

turn:"REMOVED SENSITIVE VALUE" - udp,tcp

Signaling servers (mode: internal):

no custom server configured

Browser: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:95.0) Gecko/20100101 Firefox/95.0

st3iny commented 2 years ago

This occurs when 2 processes want to write to your db at the same time. Please retry the generation command when your server is not so busy. Also, please make sure that you don't run preview:pre-generate while running preview:generate-all.

This error should not persist and if it does please let me know.

st3iny commented 2 years ago

Closing as this seems to be resolved. Otherwise, please reopen the issue or create a new one.