search

nextcloud / gallery

DEPRECATED Gallery app was replaced by Photos
https://github.com/nextcloud/photos
GNU Affero General Public License v3.0
109 stars 58 forks source link

The gallery is hanging (redis-server or php-fpm ? ) #449

Closed sosed213 closed 4 years ago

sosed213 commented 6 years ago

Steps to reproduce

When the web app gallery is paged, hangs for 5-10 seconds. The preview pictures are not uploaded.

At this point, the server loads the CPU php7-FPM 60%, and radis-server 27%.

Then it hangs, and it loads further.

I noticed that hangs occur immediately after keyspace_messes in the radis monitor. keyspace_hits:3343725 keyspace_misses:15172

Such a problem is probably more than a year old. On previous versions, it was the same.

This problem is observed in both mysql and postgresql. On php7.0 and on php7.1.

If you start the server without a radis-server, then the cloud starts to work more slowly.

Server configuration

Core i5, 16gb, ssd 120gb + 2tb.

Operating system: Ubuntu Server 16.04 Linux 4.4.0-128-generic #154-Ubuntu SMP Fri May 25 14:15:18 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux

Web server: nginx/1.14.0

Database: mysql Ver 15.1 Distrib 10.2.16-MariaDB, for debian-linux-gnu (x86_64) using readline 5.2 psql (PostgreSQL) 10.4 (Ubuntu 10.4-2.pgdg16.04+1)

PHP version: PHP 7.0.30-1+ubuntu16.04.1+deb.sury.org+1 (cli) (built: May 2 2018 12:43:14) ( NTS ) Copyright (c) 1997-2017 The PHP Group Zend Engine v3.0.0, Copyright (c) 1998-2017 Zend Technologies with Zend OPcache v7.0.30-1+ubuntu16.04.1+deb.sury.org+1, Copyright (c) 1999-2017, by Zend Technologies

PHP 7.1.18-1+ubuntu16.04.1+deb.sury.org+1 (cli) (built: Jun 11 2018 14:22:30) ( NTS ) Copyright (c) 1997-2018 The PHP Group Zend Engine v3.1.0, Copyright (c) 1998-2018 Zend Technologies with Zend OPcache v7.1.18-1+ubuntu16.04.1+deb.sury.org+1, Copyright (c) 1999-2018, by Zend Technologies

Nextcloud version: (see Nextcloud admin page) Cloud#1 Nextcloud 13.0.4 Cloud#2 Nextcloud-Test 13.0.4

Updated from an older Nextcloud/ownCloud or fresh install: Cloud#1 and Cloud#2 Fresh install.

Where did you install Nextcloud from:

Signing status: Cloud#1 and Cloud#2 No errors have been found.

List of activated apps:

App list Cloud1 ``` Enabled: - activity: 2.6.1 - apporder: 0.4.1 - audioplayer: 2.3.0 - bookmarks: 0.11.0 - bruteforcesettings: 1.1.0 - calendar: 1.6.1 - comments: 1.3.0 - contacts: 2.1.5 - dav: 1.4.7 - deck: 0.3.1 - drawio: 0.8.9 - dropit: 0.1.1 - federatedfilesharing: 1.3.1 - files: 1.8.0 - files_external: 1.4.1 - files_pdfviewer: 1.2.1 - files_sharing: 1.5.0 - files_texteditor: 2.5.1 - files_trashbin: 1.3.0 - files_versions: 1.6.0 - files_videoplayer: 1.2.0 - firstrunwizard: 2.2.1 - flowupload: 0.0.7 - gallery: 18.0.0 - logreader: 2.0.0 - lookup_server_connector: 1.1.0 - mail: 0.8.2 - nextcloud_announcements: 1.2.0 - notes: 2.3.2 - notifications: 2.1.2 - oauth2: 1.1.1 - ocsms: 1.13.1 - onlyoffice: 1.3.0 - password_policy: 1.3.0 - previewgenerator: 1.0.9 - provisioning_api: 1.3.0 - radio: 0.6.1 - rainloop: 5.1.0 - serverinfo: 1.3.0 - sharebymail: 1.3.0 - spreed: 3.2.2 - tasks: 0.9.6 - theming: 1.4.5 - twofactor_backupcodes: 1.2.3 - unsplash: 1.1.1 - updatenotification: 1.3.0 - workflowengine: 1.3.0 Disabled: - admin_audit - admin_notifications - encryption - federation - files_downloadactivity - ojsxc - survey_client - systemtags - user_external - user_ldap ```
App list Cloud2 ``` Enabled: - activity: 2.6.1 - admin_audit: 1.3.0 - admin_notifications: 1.0.1 - apporder: 0.4.1 - audioplayer: 2.3.0 - bookmarks: 0.11.0 - calendar: 1.6.1 - comments: 1.3.0 - contacts: 2.1.5 - dav: 1.4.7 - deck: 0.3.1 - external: 3.0.3 - federatedfilesharing: 1.3.1 - federation: 1.3.0 - files: 1.8.0 - files_downloadactivity: 1.2.0 - files_external: 1.4.1 - files_pdfviewer: 1.2.1 - files_sharing: 1.5.0 - files_snapshots: 0.1.1 - files_texteditor: 2.5.1 - files_trashbin: 1.3.0 - files_versions: 1.6.0 - files_videoplayer: 1.2.0 - firstrunwizard: 2.2.1 - gallery: 18.0.0 - groupfolders: 1.2.0 - logreader: 2.0.0 - lookup_server_connector: 1.1.0 - mail: 0.8.2 - news: 12.0.4 - nextcloud_announcements: 1.2.0 - notes: 2.3.2 - notifications: 2.1.2 - oauth2: 1.1.1 - ocsms: 1.13.1 - onlyoffice: 1.3.0 - password_policy: 1.3.0 - previewgenerator: 1.0.9 - provisioning_api: 1.3.0 - ransomware_protection: 1.1.0 - serverinfo: 1.3.0 - sharebymail: 1.3.0 - survey_client: 1.1.0 - systemtags: 1.3.0 - telephoneprovider: 1.0.1 - theming: 1.4.5 - twofactor_backupcodes: 1.2.3 - unsplash: 1.1.1 - updatenotification: 1.3.0 - weather: 1.5.1 - workflowengine: 1.3.0 Disabled: - encryption - gpxpod - user_external - user_ldap ```

Nextcloud configuration:

Config report Cloud1 ``` { "system": { "instanceid": "***REMOVED SENSITIVE VALUE***", "passwordsalt": "***REMOVED SENSITIVE VALUE***", "secret": "***REMOVED SENSITIVE VALUE***", "trusted_domains": [ "cloud.mydomain.ru", ], "datadirectory": "***REMOVED SENSITIVE VALUE***", "overwrite.cli.url": "https:\/\/cloud.mydomain.ru", "overwriteprotocol": "https", "dbtype": "mysql", "version": "13.0.4.0", "dbname": "***REMOVED SENSITIVE VALUE***", "dbhost": "***REMOVED SENSITIVE VALUE***", "dbport": "", "dbtableprefix": "oc_", "mysql.utf8mb4": true, "htaccess.RewriteBase": "\/", "dbuser": "***REMOVED SENSITIVE VALUE***", "dbpassword": "***REMOVED SENSITIVE VALUE***", "installed": true, "loglevel": 2, "logtimezone": "Asia\/Omsk", "logfile": "\/var\/www\/cloud12\/data\/nextcloud12.log", "log_rotate_size": 104857600, "cron_log": true, "filesystem_check_changes": true, "quota_include_external_storage": false, "knowledgebaseenabled": false, "cache_path": "\/var\/cache\/cloud", "memcache.local": "\\OC\\Memcache\\Redis", "filelocking.enabled": "true", "memcache.locking": "\\OC\\Memcache\\Redis", "redis": { "host": "***REMOVED SENSITIVE VALUE***", "port": 6379, "timeout": 0, "dbindex": 0 }, "maintenance": false, "theme": "", "enable_previews": true, "enabledPreviewProviders": [ "OC\\Preview\\Movie", "OC\\Preview\\Image", "OC\\Preview\\PNG", "OC\\Preview\\JPEG", "OC\\Preview\\GIF", "OC\\Preview\\BMP", "OC\\Preview\\XBitmap" ], "enable_movie_transcode": true, "mail_smtpmode": "smtp", "mail_smtpsecure": "ssl", "mail_from_address": "***REMOVED SENSITIVE VALUE***", "mail_domain": "***REMOVED SENSITIVE VALUE***", "mail_smtpauth": 1, "mail_smtpauthtype": "LOGIN", "mail_smtphost": "***REMOVED SENSITIVE VALUE***", "mail_smtpport": "465", "mail_smtpname": "***REMOVED SENSITIVE VALUE***", "mail_smtppassword": "***REMOVED SENSITIVE VALUE***" } } ```
Config report Cloud2 ``` { "system": { "instanceid": "***REMOVED SENSITIVE VALUE***", "passwordsalt": "***REMOVED SENSITIVE VALUE***", "secret": "***REMOVED SENSITIVE VALUE***", "trusted_domains": [ "cloud2.mydomain.ru", ], "datadirectory": "***REMOVED SENSITIVE VALUE***", "overwrite.cli.url": "http:\/\/cloud2.mydomain.ru", "dbtype": "pgsql", "version": "13.0.4.0", "dbname": "***REMOVED SENSITIVE VALUE***", "dbhost": "***REMOVED SENSITIVE VALUE***", "dbport": "", "dbtableprefix": "oc_", "dbuser": "***REMOVED SENSITIVE VALUE***", "dbpassword": "***REMOVED SENSITIVE VALUE***", "installed": true, "filesystem_check_changes": true, "loglevel": 2, "logtimezone": "Asia\/Omsk", "log_rotate_size": 104857600, "cron_log": true, "quota_include_external_storage": false, "knowledgebaseenabled": false, "cache_path": "\/var\/cache\/cloud", "memcache.local": "\\OC\\Memcache\\Redis", "filelocking.enabled": "true", "memcache.locking": "\\OC\\Memcache\\Redis", "redis": { "host": "***REMOVED SENSITIVE VALUE***", "port": 6379, "timeout": 0, "dbindex": 0 }, "enable_previews": true, "preview_max_x": 2048, "preview_max_y": 2048, "preview_max_scale_factor": 2, "enabledPreviewProviders": [ "OC\\Preview\\Movie", "OC\\Preview\\Image", "OC\\Preview\\PNG", "OC\\Preview\\JPEG", "OC\\Preview\\GIF", "OC\\Preview\\BMP", "OC\\Preview\\XBitmap" ], "enable_movie_transcode": true, "mail_smtpmode": "smtp", "mail_smtpauthtype": "LOGIN", "mail_smtpsecure": "ssl", "mail_from_address": "***REMOVED SENSITIVE VALUE***", "mail_domain": "***REMOVED SENSITIVE VALUE***", "mail_smtpauth": 1, "mail_smtphost": "***REMOVED SENSITIVE VALUE***", "mail_smtpport": "465", "mail_smtpname": "***REMOVED SENSITIVE VALUE***", "mail_smtppassword": "***REMOVED SENSITIVE VALUE***", "updater.release.channel": "beta", "maintenance": false, "theme": "" } } ```

Are you using external storage, if yes which one: local/smb/sftp/... /mnt/disk2/Doc

Are you using encryption: yes/no No

Are you using an external user-backend, if yes which one: LDAP/ActiveDirectory/Webdav/... No

Client configuration

Browser: Chrome Firefox

Operating system: Windows 7, Windows 10, Android

Logs

Web server error log

Web server error log ``` Insert your webserver log here ```

Nextcloud log (data/nextcloud.log)

Nextcloud log ``` Insert your Nextcloud log here ```

Browser log

Browser log ``` Insert your browser log here, this could for example include: a) The javascript console log b) The network log c) ... ```
PhieF commented 6 years ago

I have the same issue, issue I didn't have months ago. Even with already generated previews, redis enable

influenist commented 5 years ago

I reported the same issue already for a while: https://help.nextcloud.com/t/redis-php-fpm-issues-with-nextcloud/25910/11

skjnldsv commented 4 years ago

Nothin in the logs?

ghost commented 4 years ago

This issue has been automatically marked as stale because it has not had recent activity and seems to be missing some essential information. It will be closed if no further activity occurs. Thank you for your contributions.