[Bug]: A cron job is generating previews of every file causing previews folder to flood and filecache table to grow too large

[muchachagrande]

⚠️ This issue respects the following points: ⚠️

• [X] This is a bug, not a question or a configuration/webserver/proxy issue.
• [X] This issue is not already reported on Github OR Nextcloud Community Forum (I've searched it).
• [X] Nextcloud Server is up to date. See Maintenance and Release Schedule for supported versions.
• [X] I agree to follow Nextcloud's Code of Conduct.

Bug description

A cron job is triggering a full file scan and generating previews of all the files. As I have an external NAS disk through SMB the amount of files is huge so after the scan that lasted many hours the appdata previews folder is flooded with many, many files and the oc_filecache grows too large. After this initial scan, there is some other job that triggers a query that lasts so long that the CPU is busy for hours. I managed to find out that the query is

SELECT "fileid" FROM "oc_filecache" WHERE ("storage" = $1) AND ("size" < $2) ORDER BY "fileid" DESC

My workaround was to temporary disable the crontab to avoid triggering cron jobs and then deleted previews folder and did an occ files:scan-app-data. I had to reboot the server to stop the neverending query before doing these steps. Unfortunately the cron job that scans all files is triggered periodically so this problem happened again and I had to apply the fix again. Now I have temporarily disabled preview generation but I think that a better solution would be not to generate previews massively but only when entering a folder as it worked before upgrading. This problem didn't happen on NC28. It started to happen after upgrade from 28.0.6 to 29.0.1.

Steps to reproduce

There are no steps from my part. All this happens by triggered cron jobs

Expected behavior

There should be no full scans with previews generation at least the administrator ask for a pre-generation. In my server previews were generated on directory access but after upgrading from 28.0.6 to 29.0.1 it started this full scan.

Installation method

Community VM appliance

Nextcloud Server version

29

Operating system

Debian/Ubuntu

PHP engine version

PHP 8.1

Web server

Apache (supported)

Database engine version

PostgreSQL

Is this bug present after an update or on a fresh install?

Upgraded to a MAJOR version (ex. 22 to 23)

Are you using the Nextcloud Server Encryption module?

None

What user-backends are you using?

• [X] Default user-backend (database)
• [ ] LDAP/ Active Directory
• [ ] SSO - SAML
• [ ] Other

Configuration report

{
    "system": {
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": [
        [DOMAIN LIST]
        ],
        "trusted_proxies": "***REMOVED SENSITIVE VALUE***",
        "allow_local_remote_servers": true,
        "datadirectory": "***REMOVED SENSITIVE VALUE***",
        "dbtype": "pgsql",
        "version": "29.0.2.2",
        "overwrite.cli.url": "https:\/\/cloud.com\/",
        "dbname": "***REMOVED SENSITIVE VALUE***",
        "dbhost": "***REMOVED SENSITIVE VALUE***",
        "dbport": "",
        "dbtableprefix": "oc_",
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "installed": true,
        "instanceid": "***REMOVED SENSITIVE VALUE***",
        "upgrade.disable-web": true,
        "log_type": "file",
        "logfile": "\/var\/log\/nextcloud\/nextcloud.log",
        "loglevel": "2",
        "log.condition": {
            "apps": [
                "admin_audit"
            ]
        },
        "mail_smtpmode": "smtp",
        "remember_login_cookie_lifetime": "1800",
        "log_rotate_size": "10485760",
        "trashbin_retention_obligation": "auto, 60",
        "versions_retention_obligation": "auto, 180",
        "activity_expire_days": "120",
        "simpleSignUpLink.shown": false,
        "memcache.local": "\\OC\\Memcache\\Redis",
        "filelocking.enabled": true,
        "memcache.distributed": "\\OC\\Memcache\\Redis",
        "memcache.locking": "\\OC\\Memcache\\Redis",
        "redis": {
            "host": "***REMOVED SENSITIVE VALUE***",
            "port": 0,
            "timeout": 0.5,
            "dbindex": 0,
            "password": "***REMOVED SENSITIVE VALUE***"
        },
        "default_phone_region": "us",
        "logtimezone": "[timezone]",
        "default_language": "[language]",
        "default_locale": "[locale]",
        "htaccess.RewriteBase": "\/",
        "maintenance": false,
        "mail_smtpsecure": "ssl",
        "mail_sendmailmode": "smtp",
        "mail_smtpauth": 1,
        "mail_smtphost": "***REMOVED SENSITIVE VALUE***",
        "mail_smtpport": "465",
        "mail_smtpauthtype": "LOGIN",
        "mail_from_address": "***REMOVED SENSITIVE VALUE***",
        "mail_domain": "***REMOVED SENSITIVE VALUE***",
        "mail_smtpname": "***REMOVED SENSITIVE VALUE***",
        "mail_smtppassword": "***REMOVED SENSITIVE VALUE***",
        "knowledgebaseenabled": false,
        "lost_password_link": "disabled",
        "enable_previews": true,
        "enabledPreviewProviders": [
            "OC\\Preview\\MP3",
            "OC\\Preview\\TXT",
            "OC\\Preview\\MarkDown",
            "OC\\Preview\\Krita",
            "OC\\Preview\\OpenDocument",
            "OC\\Preview\\Imaginary",
            "OC\\Preview\\PDF",
            "OC\\Preview\\MSOffice2003",
            "OC\\Preview\\MSOfficeDoc",
            "OC\\Preview\\MSOffice2007",
            "OC\\Preview\\StarOffice",
            "OC\\Preview\\SVG",
            "OC\\Preview\\TIFF",
            "OC\\Preview\\Font",
            "OC\\Preview\\Movie",
            "OC\\Preview\\MKV",
            "OC\\Preview\\MP4",
            "OC\\Preview\\AVI",
            "OC\\Preview\\Illustrator",
            "OC\\Preview\\Photoshop",
            "OC\\Preview\\Postscript",
            "OC\\Preview\\Epub"
        ],
        "preview_imaginary_url": "***REMOVED SENSITIVE VALUE***",
        "twofactor_enforced": "false",
        "twofactor_enforced_groups": [],
        "twofactor_enforced_excluded_groups": [],
        "skeletondirectory": "",
        "theme": "",
        "filesystem_check_changes": true,
        "preview_concurrency_new": "8",
        "preview_concurrency_all": "16",
        "updater.release.channel": "stable",
        "maintenance_window_start": 1,
        "app_install_overwrite": [
            "integration_libretranslate",
            "twofactor_email",
            "keeweb"
        ]
    },
    "apps": {
        "activity": {
            "installed_version": "2.21.1",
            "types": "filesystem",
            "enabled": "yes"
        },
        "admin_audit": {
            "types": "logging",
            "enabled": "yes",
            "logfile": "\/var\/log\/nextcloud\/audit.log",
            "installed_version": "1.19.0"
        },
        "assistant": {
            "enabled": "yes",
            "types": "",
            "installed_version": "1.0.9",
            "free_prompt_picker_enabled": "1",
            "assistant_enabled": "1",
            "stt_folder": "stt_recordings",
            "speech_to_text_picker_enabled": "1",
            "text_to_image_picker_enabled": "1"
        },
        "backgroundjob": {
            "lastjob": "67"
        },
        "bookmarks": {
            "enabled": "[\"users\",\"admin\"]",
            "previews.screenly.url": "",
            "types": "",
            "previews.screenly.token": "",
            "performance.maxBookmarksperAccount": "",
            "previews.screenshotmachine.key": "",
            "previews.webshot.url": "",
            "previews.pageres.env": "",
            "privacy.enableScraping": "true",
            "installed_version": "14.1.2"
        },
        "bruteForce": {
        },
        "bruteforcesettings": {
            "types": "",
            "installed_version": "2.9.0",
            "enabled": "yes"
        },
        "calendar": {
            "types": "",
            "enabled": "[\"admin\",\"users\"]",
            "installed_version": "4.7.6"
        },
        "cfg_share_links": {
            "types": "",
            "installed_version": "4.2.0",
            "enabled": "no",
            "default_label_mode": "1"
        },
        "circles": {
            "types": "filesystem,dav",
            "enabled": "yes",
            "loopback_tmp_path": "\/",
            "migration_22": "1",
            "migration_22_1": "1",
            "loopback_tmp_scheme": "https",
            "migration_run": "0",
            "maintenance_update": "{\"3\":1717884308,\"2\":1717885202,\"1\":1717885202}",
            "installed_version": "29.0.0-dev",
            "maintenance_run": "0"
        },
        "cloud_federation_api": {
            "types": "filesystem",
            "enabled": "yes",
            "installed_version": "1.12.0"
        },
        "comments": {
            "types": "logging",
            "enabled": "yes",
            "installed_version": "1.19.0"
        },
        "contacts": {
            "types": "dav",
            "enabled": "[\"admin\",\"users\"]",
            "installed_version": "6.0.0"
        },
        "contactsinteraction": {
            "types": "dav",
            "enabled": "[\"users\",\"admin\"]",
            "installed_version": "1.10.0"
        },
        "core": {
            "installedat": "1653035702.5341",
            "vendor": "nextcloud",
            "shareapi_allow_links_exclude_groups": "[\"others\"]",
            "public_webdav": "dav\/appinfo\/v1\/publicwebdav.php",
            "public_files": "files_sharing\/public.php",
            "shareapi_enforce_expire_date": "no",
            "backgroundjobs_mode": "cron",
            "shareapi_expire_after_n_days": "1",
            "shareapi_default_expire_date": "yes",
            "shareapi_enforce_links_password": "no",
            "shareapi_enable_link_password_by_default": "no",
            "theming.variables": "3a274db0abf52b2dfe2103835efc9e42",
            "moveavatarsdone": "yes",
            "previewsCleanedUp": "1",
            "shareapi_exclude_groups": "yes",
            "shareapi_default_permission_cancreate": "no",
            "shareapi_default_permission_canupdate": "no",
            "shareapi_default_permission_candelete": "no",
            "shareapi_default_permissions": "1",
            "shareapi_default_permission_canshare": "no",
            "newUser.sendEmail": "yes",
            "emailTestSuccessful": "1",
            "shareapi_exclude_groups_list": "[\"others\"]",
            "files_metadata_installed": "1",
            "ai.text2image_provider": "\"integration_openai_image_generation\"",
            "shareapi_restrict_user_enumeration_to_phone": "yes",
            "ai.textprocessing_provider_preferences": "{\"OCP\\\\TextProcessing\\\\FreePromptTaskType\":\"OCA\\\\OpenAi\\\\TextProcessing\\\\FreePromptProvider\",\"OCP\\\\TextProcessing\\\\SummaryTaskType\":\"OCA\\\\OpenAi\\\\TextProcessing\\\\SummaryProvider\",\"OCP\\\\TextProcessing\\\\HeadlineTaskType\":\"OCA\\\\OpenAi\\\\TextProcessing\\\\HeadlineProvider\",\"OCA\\\\OpenAi\\\\TextProcessing\\\\ReformulateTaskType\":\"OCA\\\\OpenAi\\\\TextProcessing\\\\ReformulateProvider\"}",
            "metadataGenerationLastHandledUser": "lala",
            "ai.stt_provider": "\"OCA\\\\OpenAi\\\\SpeechToText\\\\STTProvider\"",
            "lastupdatedat": "1717800989",
            "lastupdateResult": "[]",
            "ai.translation_provider_preferences": "[\"OCA\\\\IntegrationLibreTranslate\\\\LibretranslateProvider\",\"OCA\\\\OpenAi\\\\Translation\\\\TranslationProvider\"]",
            "lastcron": "1717885205",
            "oc.integritycheck.checker": "[]",
            "files_metadata": "{\"photos-original_date_time\":{\"value\":null,\"type\":\"int\",\"etag\":\"\",\"indexed\":true,\"editPermission\":0},\"photos-size\":{\"value\":null,\"type\":\"array\",\"etag\":\"\",\"indexed\":false,\"editPermission\":0},\"photos-exif\":{\"value\":null,\"type\":\"array\",\"etag\":\"\",\"indexed\":false,\"editPermission\":0},\"photos-ifd0\":{\"value\":null,\"type\":\"array\",\"etag\":\"\",\"indexed\":false,\"editPermission\":0},\"photos-gps\":{\"value\":null,\"type\":\"array\",\"etag\":\"\",\"indexed\":false,\"editPermission\":0},\"photos-place\":{\"value\":null,\"type\":\"string\",\"etag\":\"\",\"indexed\":true,\"editPermission\":0},\"blurhash\":{\"value\":null,\"type\":\"string\",\"etag\":\"665610056b140\",\"indexed\":false,\"editPermission\":0}}"
        },
        "dashboard": {
            "types": "",
            "enabled": "[\"admin\",\"users\"]",
            "installed_version": "7.9.0"
        },
        "dav": {
            "types": "filesystem",
            "enabled": "yes",
            "installed_version": "1.30.1",
            "needs_system_address_book_sync": "no",
            "sendEventRemindersPush": "yes",
            "regeneratedBirthdayCalendarsForYearFix": "yes",
            "buildCalendarSearchIndex": "yes",
            "buildCalendarReminderIndex": "yes",
            "chunks_migrated": "1",
            "system_addressbook_exposed": "no"
        },
        "deck": {
            "installed_version": "1.7.0",
            "types": "dav",
            "enabled": "no"
        },
        "extract": {
            "types": "",
            "installed_version": "1.3.6",
            "enabled": "no"
        },
        "federatedfilesharing": {
            "types": "",
            "enabled": "yes",
            "installed_version": "1.19.0"
        },
        "federation": {
            "types": "authentication",
            "enabled": "yes",
            "installed_version": "1.19.0"
        },
        "files": {
            "installed_version": "2.1.0",
            "types": "filesystem",
            "enabled": "yes",
            "default_quota": "1 GB",
            "max_chunk_size": "104857600"
        },
        "files_downloadlimit": {
            "installed_version": "2.0.0",
            "types": "",
            "enabled": "yes"
        },
        "files_external": {
            "installed_version": "1.21.0",
            "types": "filesystem",
            "enabled": "yes",
            "user_mounting_backends": "ftp,dav,owncloud,sftp,amazons3,swift,smb,\\OC\\Files\\Storage\\SFTP_Key,\\OC\\Files\\Storage\\SMB_OC",
            "allow_user_mounting": "no"
        },
        "files_pdfviewer": {
            "types": "",
            "installed_version": "2.10.0",
            "enabled": "[\"admin\",\"users\"]"
        },
        "files_reminders": {
            "installed_version": "1.2.0",
            "types": "",
            "enabled": "yes"
        },
        "files_rightclick": {
            "types": "",
            "enabled": "no",
            "installed_version": "1.6.0"
        },
        "files_sharing": {
            "installed_version": "1.21.0",
            "types": "filesystem",
            "enabled": "yes",
            "lookupServerUploadEnabled": "no"
        },
        "files_trashbin": {
            "types": "filesystem,dav",
            "enabled": "yes",
            "installed_version": "1.19.0"
        },
        "files_versions": {
            "types": "filesystem,dav",
            "enabled": "yes",
            "installed_version": "1.22.0"
        },
        "firstrunwizard": {
            "installed_version": "2.13.0",
            "types": "logging",
            "enabled": "no"
        },
        "gptfreeprompt": {
            "enabled": "yes",
            "installed_version": "1.0.2",
            "types": ""
        },
        "gpxpod": {
            "maptiler_api_key": "[API KEY]",
            "use_gpsbabel": "0",
            "reset304": "1",
            "resetPics404": "1",
            "enabled": "[\"admin\",\"users\"]",
            "installed_version": "5.0.18",
            "types": ""
        },
        "integration_deepl": {
            "installed_version": "1.1.0",
            "enabled": "no",
            "types": ""
        },
        "integration_giphy": {
            "enabled": "yes",
            "types": "",
            "search_gifs_enabled": "0",
            "rating": "r",
            "installed_version": "1.0.10"
        },
        "integration_libretranslate": {
            "from_lang": "en",
            "to_lang": "es",
            "host": "http:\/\/[IP]",
            "apikey": "",
            "fromLang": "fr",
            "toLang": "es",
            "types": "",
            "enabled": "yes",
            "port": "[PORT]",
            "installed_version": "1.1.1"
        },
        "integration_openai": {
            "basic_user": "",
            "api_key": "",
            "max_tokens": "1000",
            "quota_period": "30",
            "quotas": "[0,0,0]",
            "url": "http:\/\/[IP]",
            "localai_text_generation_time": "36",
            "request_timeout": "240",
            "basic_password": "",
            "use_basic_auth": "0",
            "service_name": "",
            "chat_endpoint_enabled": "1",
            "localai_image_generation_time": "92",
            "enabled": "yes",
            "types": "",
            "default_completion_model_id": "gpt-4",
            "installed_version": "2.0.1",
            "image_picker_enabled": "1"
        },
        "integration_openstreetmap": {
            "search_location_enabled": "0",
            "types": "",
            "installed_version": "1.0.12",
            "enabled": "[\"admin\",\"users\"]",
            "maptiler_api_key": "[API KEY]",
            "mapbox_api_key": "[API KEY]"
        },
        "integration_peertube": {
            "instances": "https:\/\/[instance]",
            "enabled": "[\"admin\",\"users\"]",
            "types": "",
            "installed_version": "1.0.3"
        },
        "integration_replicate": {
            "installed_version": "1.0.8",
            "types": "",
            "enabled": "no",
            "api_key": "[API KEY]"
        },
        "integration_tmdb": {
            "api_key": "",
            "enabled": "yes",
            "types": "",
            "installed_version": "1.0.4"
        },
        "integration_youtube": {
            "enabled": "[\"admin\",\"users\"]",
            "types": "",
            "installed_version": "0.2.1",
            "search_enabled": "false",
            "token": "[token]"
        },
        "issuetemplate": {
            "installed_version": "0.7.0",
            "types": "",
            "enabled": "no"
        },
        "keeweb": {
            "types": "",
            "installed_version": "0.6.18",
            "enabled": "[\"users\",\"admin\"]"
        },
        "logreader": {
            "installed_version": "2.14.0",
            "types": "logging",
            "enabled": "yes",
            "levels": "11111",
            "shownLevels": "[0,1,2,3,4]",
            "liveLog": "true"
        },
        "lookup_server_connector": {
            "types": "authentication",
            "enabled": "yes",
            "installed_version": "1.17.0"
        },
        "mail": {
            "types": "",
            "enabled": "[\"admin\",\"users\"]",
            "google_oauth_client_id": "[client id]",
            "installed_version": "3.7.1",
            "google_oauth_client_secret": "[secret]"
        },
        "maps": {
            "types": "filesystem",
            "enabled": "yes",
            "mapboxAPIKEY": "[api key]",
            "lastAddressLookup": "16625742258",
            "osrmDEMO": "0",
            "installed_version": "1.4.0"
        },
        "metadata": {
            "types": "",
            "installed_version": "0.19.0",
            "enabled": "no"
        },
        "nextcloud_announcements": {
            "types": "logging",
            "enabled": "yes",
            "installed_version": "1.18.0",
            "pub_date": "Thu, 24 Oct 2019 00:00:00 +0200"
        },
        "notes": {
            "types": "",
            "enabled": "[\"admin\",\"users\"]",
            "installed_version": "4.10.0"
        },
        "notifications": {
            "types": "logging",
            "enabled": "yes",
            "installed_version": "2.17.0",
            "setting_batchtime": "0",
            "sound_notification": "no",
            "sound_talk": "no"
        },
        "notify_push": {
            "enabled": "yes",
            "base_endpoint": "https:\/\/cloud.com\/\/push",
            "types": "filesystem",
            "cookie": "***REMOVED SENSITIVE VALUE***",
            "installed_version": "0.6.12"
        },
        "oauth2": {
            "installed_version": "1.17.0",
            "types": "authentication",
            "enabled": "yes"
        },
        "password_policy": {
            "types": "authentication",
            "enabled": "yes",
            "installed_version": "1.19.0"
        },
        "passwords": {
            "enabled": "[\"admin\",\"users\"]",
            "web\/php\/version\/string": "8.1.2-1ubuntu2.17",
            "web\/php\/version\/id": "80102",
            "cron\/php\/version\/id": "80102",
            "passwords\/localdb\/type": "hibp",
            "types": "",
            "SSEv1ServerKey": "[server key]",
            "service\/preview": "default",
            "service\/words": "auto",
            "service\/favicon": "bi",
            "service\/favicon\/bi\/counter": "22:10:0",
            "backup\/update\/restored": "0",
            "migration\/customFields": "2020.12.2",
            "survey\/server\/mode": "0",
            "cron\/php\/version\/string": "8.1.2-1ubuntu2.17",
            "installed_version": "2024.5.10",
            "nightly\/enabled": ""
        },
        "phonetrack": {
            "enabled": "yes",
            "installed_version": "0.8.1",
            "types": ""
        },
        "photos": {
            "installed_version": "2.5.0",
            "enabled": "yes",
            "lastPlaceMappedUser": "popo",
            "types": "dav,authentication",
            "lastPlaceMappingDone": "true"
        },
        "picker": {
            "enabled": "[\"admin\",\"users\"]",
            "types": "",
            "installed_version": "1.0.8"
        },
        "privacy": {
            "types": "",
            "enabled": "[\"admin\",\"users\"]",
            "installed_version": "1.13.0"
        },
        "provisioning_api": {
            "types": "prevent_group_restriction",
            "enabled": "yes",
            "installed_version": "1.19.0"
        },
        "qownnotesapi": {
            "types": "",
            "enabled": "yes",
            "installed_version": "24.4.0"
        },
        "recommendations": {
            "types": "",
            "installed_version": "2.1.0",
            "enabled": "[\"admin\",\"users\"]"
        },
        "related_resources": {
            "installed_version": "1.4.0",
            "types": "",
            "enabled": "yes"
        },
        "richdocuments": {
            "types": "prevent_group_restriction",
            "public_wopi_url": "https:\/\/cloud.com",
            "disable_certificate_verification": "",
            "wopi_url": "https:\/\/cloud.com\/office",
            "wopi_allowlist": "[IP list]",
            "canonical_webroot": "",
            "external_apps": "",
            "installed_version": "8.4.2",
            "enabled": "yes",
            "edit_groups": "admin|users",
            "use_groups": "admin|users"
        },
        "serverinfo": {
            "types": "",
            "enabled": "[\"admin\",\"users\"]",
            "installed_version": "1.19.0",
            "cached_count_storages": "29",
            "cached_count_filecache": "8991361"
        },
        "settings": {
            "types": "",
            "enabled": "yes",
            "installed_version": "1.12.0",
            "profile_enabled_by_default": "0"
        },
        "sharebymail": {
            "types": "filesystem",
            "enabled": "yes",
            "installed_version": "1.19.0"
        },
        "sketch_picker": {
            "enabled": "yes",
            "installed_version": "1.0.2",
            "types": ""
        },
        "socialsharing_email": {
            "installed_version": "3.1.0",
            "types": "",
            "enabled": "yes"
        },
        "spreed": {
            "project_access_invalidated": "1",
            "enabled": "yes",
            "has_reference_id": "yes",
            "types": "dav,prevent_group_restriction",
            "call_recording_transcription": "yes",
            "start_conversations": "[\"admin\",\"users\"]",
            "allowed_groups": "[\"admin\",\"users\",\"others\"]",
            "sip_bridge_dialin_info": "***REMOVED SENSITIVE VALUE***",
            "sip_bridge_shared_secret": "***REMOVED SENSITIVE VALUE***",
            "stun_servers": "***REMOVED SENSITIVE VALUE***",
            "signaling_ticket_secret": "***REMOVED SENSITIVE VALUE***",
            "recording_servers": "***REMOVED SENSITIVE VALUE***",
            "sip_bridge_groups": "[\"admin\"]",
            "start_calls": "1",
            "federation_enabled": "yes",
            "installed_version": "19.0.1",
            "signaling_servers": "***REMOVED SENSITIVE VALUE***",
            "recording_consent": "2",
            "changelog": "no",
            "signaling_token_privkey_es256": "***REMOVED SENSITIVE VALUE***",
            "signaling_token_pubkey_es256": "***REMOVED SENSITIVE VALUE***",
            "turn_servers": "***REMOVED SENSITIVE VALUE***"
        },
        "stt_helper": {
            "installed_version": "1.1.1",
            "enabled": "yes",
            "types": ""
        },
        "stt_whisper": {
            "types": "",
            "threads": "4",
            "installed_version": "1.0.7",
            "enabled": "no",
            "model": "medium",
            "ffmpeg_binary": ""
        },
        "support": {
            "installed_version": "1.7.0",
            "types": "session",
            "enabled": "no",
            "SwitchUpdaterServerHasRun": "yes"
        },
        "survey_client": {
            "installed_version": "1.12.0",
            "types": "",
            "enabled": "no"
        },
        "suspicious_login": {
            "types": "authentication",
            "installed_version": "7.0.0",
            "enabled": "no"
        },
        "systemtags": {
            "types": "logging",
            "enabled": "yes",
            "installed_version": "1.19.0"
        },
        "tasks": {
            "installed_version": "0.16.0",
            "enabled": "[\"admin\",\"users\"]",
            "types": ""
        },
        "text": {
            "types": "dav",
            "installed_version": "3.10.0",
            "enabled": "yes"
        },
        "text2image_helper": {
            "installed_version": "1.0.2",
            "enabled": "yes",
            "types": ""
        },
        "text2image_stablediffusion": {
            "enabled": "no",
            "node_binary": "\/var\/www\/nextcloud\/apps\/text2image_stablediffusion\/bin\/node",
            "installed_version": "1.0.2",
            "types": ""
        },
        "text_templates": {
            "enabled": "yes",
            "types": "",
            "installed_version": "1.0.5"
        },
        "theming": {
            "types": "logging",
            "enabled": "yes",
            "installed_version": "2.4.0",
            "name": "[NAME]",
            "disable-user-theming": "no",
            "url": "***REMOVED SENSITIVE VALUE***",
            "slogan": "***REMOVED SENSITIVE VALUE***",
            "color": "#DADADA",
            "logoheaderMime": "image\/png",
            "backgroundMime": "backgroundColor",
            "cachebuster": "51",
            "logoMime": "image\/png",
            "faviconMime": "image\/png",
            "productName": "[NAME]"
        },
        "translate": {
            "node_binary": "\/var\/www\/nextcloud\/apps\/translate\/bin\/node",
            "installed_version": "1.1.3",
            "types": "",
            "enabled": "no"
        },
        "twofactor_backupcodes": {
            "types": "",
            "enabled": "yes",
            "installed_version": "1.18.0"
        },
        "twofactor_email": {
            "types": "",
            "enabled": "yes",
            "installed_version": "2.7.4"
        },
        "twofactor_nextcloud_notification": {
            "types": "",
            "installed_version": "3.9.0",
            "enabled": "[\"users\",\"admin\"]"
        },
        "twofactor_totp": {
            "installed_version": "11.0.0-dev",
            "types": "",
            "enabled": "[\"users\",\"admin\"]"
        },
        "updatenotification": {
            "types": "",
            "enabled": "[\"admin\"]",
            "installed_version": "1.19.1",
            "integration_tmdb": "1.0.4",
            "notify_groups": "[\"admin\"]",
            "related_resources": "1.0.4",
            "update_check_errors": "0",
            "integration_openstreetmap": "1.0.6",
            "integration_giphy": "1.0.8",
            "extract": "1.3.6",
            "sketch_picker": "1.0.2",
            "picker": "1.0.8",
            "richdocuments": "8.3.4",
            "notes": "4.9.3",
            "integration_openai": "2.0.0",
            "integration_replicate": "1.0.8",
            "calendar": "4.7.6",
            "bookmarks": "13.1.3",
            "twofactor_nextcloud_notification": "3.8.0",
            "core": "29.0.0.19",
            "maps": "1.1.1",
            "qownnotesapi": "24.4.0",
            "stt_whisper": "1.0.7",
            "twofactor_totp": "6.4.1",
            "tasks": "0.16.0",
            "assistant": "1.0.8",
            "metadata": "0.19.0",
            "text_templates": "1.0.4",
            "phonetrack": "0.7.7",
            "integration_peertube": "1.0.2",
            "uppush": "1.4.1",
            "cfg_share_links": "4.2.0",
            "socialsharing_email": "3.1.0",
            "stt_helper": "1.1.0",
            "notify_push": "0.6.10",
            "passwords": "2024.5.10",
            "mail": "3.7.0",
            "contacts": "5.5.3",
            "keeweb": "0.6.18",
            "spreed": "18.0.7"
        },
        "uppush": {
            "enabled": "yes",
            "types": "",
            "installed_version": "1.4.3"
        },
        "user_status": {
            "types": "",
            "enabled": "[\"admin\",\"users\",\"others\"]",
            "installed_version": "1.9.0"
        },
        "viewer": {
            "types": "",
            "enabled": "yes",
            "installed_version": "2.3.0"
        },
        "weather_status": {
            "types": "",
            "enabled": "[\"admin\",\"users\"]",
            "installed_version": "1.9.0"
        },
        "workflowengine": {
            "types": "filesystem",
            "enabled": "yes",
            "installed_version": "2.11.0"
        }
    }
}

List of activated Apps

Enabled:
  - activity: 2.21.1
  - admin_audit: 1.19.0
  - assistant: 1.0.9
  - bookmarks: 14.1.2
  - bruteforcesettings: 2.9.0
  - calendar: 4.7.6
  - circles: 29.0.0-dev
  - cloud_federation_api: 1.12.0
  - comments: 1.19.0
  - contacts: 6.0.0
  - contactsinteraction: 1.10.0
  - dashboard: 7.9.0
  - dav: 1.30.1
  - federatedfilesharing: 1.19.0
  - federation: 1.19.0
  - files: 2.1.0
  - files_downloadlimit: 2.0.0
  - files_external: 1.21.0
  - files_pdfviewer: 2.10.0
  - files_reminders: 1.2.0
  - files_sharing: 1.21.0
  - files_trashbin: 1.19.0
  - files_versions: 1.22.0
  - gptfreeprompt: 1.0.2
  - gpxpod: 5.0.18
  - integration_giphy: 1.0.10
  - integration_libretranslate: 1.1.1
  - integration_openai: 2.0.1
  - integration_openstreetmap: 1.0.12
  - integration_peertube: 1.0.3
  - integration_tmdb: 1.0.4
  - integration_youtube: 0.2.1
  - keeweb: 0.6.18
  - logreader: 2.14.0
  - lookup_server_connector: 1.17.0
  - mail: 3.7.1
  - maps: 1.4.0
  - nextcloud_announcements: 1.18.0
  - notes: 4.10.0
  - notifications: 2.17.0
  - notify_push: 0.6.12
  - oauth2: 1.17.0
  - password_policy: 1.19.0
  - passwords: 2024.5.10
  - phonetrack: 0.8.1
  - photos: 2.5.0
  - picker: 1.0.8
  - privacy: 1.13.0
  - provisioning_api: 1.19.0
  - qownnotesapi: 24.4.0
  - recommendations: 2.1.0
  - related_resources: 1.4.0
  - richdocuments: 8.4.2
  - serverinfo: 1.19.0
  - settings: 1.12.0
  - sharebymail: 1.19.0
  - sketch_picker: 1.0.2
  - socialsharing_email: 3.1.0
  - spreed: 19.0.1
  - stt_helper: 1.1.1
  - systemtags: 1.19.0
  - tasks: 0.16.0
  - text: 3.10.0
  - text2image_helper: 1.0.2
  - text_templates: 1.0.5
  - theming: 2.4.0
  - twofactor_backupcodes: 1.18.0
  - twofactor_email: 2.7.4
  - twofactor_nextcloud_notification: 3.9.0
  - twofactor_totp: 11.0.0-dev
  - updatenotification: 1.19.1
  - uppush: 1.4.3
  - user_status: 1.9.0
  - viewer: 2.3.0
  - weather_status: 1.9.0
  - workflowengine: 2.11.0
Disabled:
  - encryption: 2.17.0
  - firstrunwizard: 2.18.0 (installed 2.13.0)
  - support: 1.12.0 (installed 1.7.0)
  - survey_client: 1.17.0 (installed 1.12.0)
  - suspicious_login: 7.0.0 (installed 7.0.0)
  - user_ldap: 1.20.0

Nextcloud Signing status

No errors have been found.

Nextcloud Logs

No related server logs about this

Additional info

No response

[kesselb]

Sounds similiar to https://github.com/nextcloud/server/issues/45654

[muchachagrande]

Yes, as I searched for cron job and filecache I didn't find it.

Additional info: When rebooted the server to stop the running tasks to apply the workaround I observed the following error in the NC log:

Error while running background job OCA\Files\BackgroundJob\ScanFiles

So that's the job that runs for so long... my guess is that the first run after the upgrade generated all the previews and the following runs after that are very slow because of the huge amount of files it generated before.

[didim99]

Have a same issue, after upgrading from NC27 to 29.0.2. Some additional info (relevant for my installation):

• Related cron job starts only during maintenance window (at 01:00 for me).
• My primary storage contains ~500k files (total size is ~1.4TB, including versions and trashbin), and external storage (local folder) contains ~1.2M files (total size is ~1.6TB).
• My oc_filecache table contains ~2.1M rows.

After upgrading to NC29 and waiting few days my oc_filecache table grown over 8M rows (and over 6GB) and slow down entire MySQL server. I stop the NC server, kill background task process, deleted all content of preview folder and all rows from oc_filecache related to them (it takes over 10 hours!) and started server again. An next day I see that the preview folder grows again. I disabled background job at all to determine source of issue and wait one week, nothing happened. Then I disabled preview generation for external storage (via admin settings UI) and enabled cron job, and today preview folder grows again (seems to scanning external storage files because I have some errors in log related to external storage files). At this moment my preview folder has only 3k files and over 580k of empty directories! It seems a serious problem for large installations.