[Bug]: Exaggerated presence of errors into the log viewer during syncing of a new macOS device (uplod ndr!)

sl-lebrit commented 1 month ago

⚠️ This issue respects the following points: ⚠️

[X] This is a bug, not a question or a configuration/webserver/proxy issue.
[X] This issue is not already reported on Github OR Nextcloud Community Forum (I've searched it).
[X] Nextcloud Server is up to date. See Maintenance and Release Schedule for supported versions.
[X] I agree to follow Nextcloud's Code of Conduct.

Bug description

It seems that many old bugs and, probably new ones, have come back to light with Nextcloud 29.0.2 (previous version 29.0 had only troubles with External They sometimes cause sync to fail an restarting Nextcloud containers is needed

List of errors found in log viewer during syncing:

PHP: Optional parameter $userId declared before required parameter $path is implicitly treated as a required parameter at /var/www/html/custom_apps/deck/lib/Service/ConfigService.php#234
PHP:Trying to access array offset on value of type null at /var/www/html/3rdparty/wapmorgan/mp3info/src/Mp3Info.php#397
PHP: Undefined array key 4 at /var/www/html/3rdparty/wapmorgan/mp3info/src/Mp3Info.php#397
PHP: Allowed memory size of 536870912 bytes exhausted (tried to allocate 2097184 bytes) at /var/www/html/3rdparty/guzzlehttp/psr7/src/Stream.php#257
CRON: DbalException An exception occurred while executing a query: SQLSTATE[HY000]: General error: 7 no connection to the server
getimagesize(): Corrupt JPEG data: 843 extraneous bytes before marker at /var/www/html/lib/private/legacy/OC_Image.php#697

Steps to reproduce

install from scratch of Docker and Nextcloud AIO 29.0.2.2, then create an account (Ubuntu Debian 22.04 LTS)
install the latest Nextcloud Desktop on a Mac
synchroniese an already existing exiting folder with thousand of files (documents and images) to the Server
wait for errors...

Expected behavior

Having the whole folder transferred on server without errors...

Installation method

Community Docker image

Nextcloud Server version

29

Operating system

Debian/Ubuntu

PHP engine version

PHP 8.2

Web server

Apache (supported)

Database engine version

PostgreSQL

Is this bug present after an update or on a fresh install?

Fresh Nextcloud Server install

Are you using the Nextcloud Server Encryption module?

None

What user-backends are you using?

[ ] Default user-backend (database)
[ ] LDAP/ Active Directory
[ ] SSO - SAML
[ ] Other

Configuration report

{   
    "system": {
        "one-click-instance": true,
        "one-click-instance.user-limit": 100,
        "memcache.local": "\\OC\\Memcache\\APCu",
        "apps_paths": [
            {   
                "path": "\/var\/www\/html\/apps",
                "url": "\/apps",
                "writable": false
            },
            {   
                "path": "\/var\/www\/html\/custom_apps",
                "url": "\/custom_apps",
                "writable": true
            }
        ],
        "appsallowlist": false,
        "check_data_directory_permissions": false,
        "memcache.distributed": "\\OC\\Memcache\\Redis",
        "memcache.locking": "\\OC\\Memcache\\Redis",
        "redis": {
            "host": "***REMOVED SENSITIVE VALUE***",
            "password": "***REMOVED SENSITIVE VALUE***",
            "port": 6379
        },
        "overwritehost": "cloud.lebrit.com",
        "overwriteprotocol": "https",
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": [
            "localhost",
            "cloud.lebrit.com"
        ],
        "datadirectory": "***REMOVED SENSITIVE VALUE***",
        "dbtype": "pgsql",
        "version": "29.0.2.2",
        "overwrite.cli.url": "https:\/\/cloud.lebrit.com\/",
        "dbname": "***REMOVED SENSITIVE VALUE***",
        "dbhost": "***REMOVED SENSITIVE VALUE***",
        "dbport": "",
        "dbtableprefix": "oc_",
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "installed": true,
        "instanceid": "***REMOVED SENSITIVE VALUE***",
        "maintenance": false,
        "updatedirectory": "\/nc-updater",
        "loglevel": 2,
        "app_install_overwrite": [
            "nextcloud-aio"
        ],
        "log_type": "file",
        "logfile": "\/var\/www\/html\/data\/nextcloud.log",
        "log_rotate_size": 10485760,
        "log.condition": {
            "apps": [
                "admin_audit"
            ]
        },
        "preview_max_x": 2048,
        "preview_max_y": 2048,
        "jpeg_quality": 60,
        "enabledPreviewProviders": {
            "1": "OC\\Preview\\Image",
            "2": "OC\\Preview\\MarkDown",
            "3": "OC\\Preview\\MP3",
            "4": "OC\\Preview\\TXT",
            "5": "OC\\Preview\\OpenDocument",
            "6": "OC\\Preview\\Movie",
            "7": "OC\\Preview\\Krita",
            "0": "OC\\Preview\\Imaginary"
        },
        "enable_previews": true,
        "upgrade.disable-web": true,
        "mail_smtpmode": "smtp",
        "trashbin_retention_obligation": "auto, 30",
        "versions_retention_obligation": "auto, 30",
        "activity_expire_days": 30,
        "simpleSignUpLink.shown": false,
        "share_folder": "\/Shared",
        "one-click-instance.link": "https:\/\/nextcloud.com\/all-in-one\/",
        "upgrade.cli-upgrade-link": "https:\/\/github.com\/nextcloud\/all-in-on>
        "maintenance_window_start": 100,
        "allow_local_remote_servers": true,
        "davstorage.request_timeout": 3600,
        "htaccess.RewriteBase": "\/",
        "dbpersistent": false,
        "auth.bruteforce.protection.enabled": true,
        "ratelimit.protection.enabled": true,
        "files_external_allow_create_new_local": true,
        "trusted_proxies": "***REMOVED SENSITIVE VALUE***",
        "preview_imaginary_url": "***REMOVED SENSITIVE VALUE***",
        "preview_imaginary_key": "***REMOVED SENSITIVE VALUE***",
        "objectstore": {
            "class": "\\OC\\Files\\ObjectStore\\S3",
            "arguments": {
                "bucket": "cloud-lebrit",
                "key": "***REMOVED SENSITIVE VALUE***",
                "secret": "***REMOVED SENSITIVE VALUE***",
                "use_ssl": true,
                "hostname": "it-mil-1.linodeobjects.com"
            }
        }
    }
}

List of activated Apps

Enabled:
  - admin_audit: 1.19.0
  - calendar: 4.7.6
  - circles: 29.0.0-dev
  - cloud_federation_api: 1.12.0
  - contacts: 6.0.0
  - dashboard: 7.9.0
  - dav: 1.30.1
  - deck: 1.13.0
  - federatedfilesharing: 1.19.0
  - files: 2.1.0
  - files_external: 1.21.0
  - files_pdfviewer: 2.10.0
  - files_reminders: 1.2.0
  - files_sharing: 1.21.0
  - files_trashbin: 1.19.0
  - files_versions: 1.22.0
  - firstrunwizard: 2.18.0
  - logreader: 2.14.0
  - lookup_server_connector: 1.17.0
  - nextcloud-aio: 0.5.0
  - nextcloud_announcements: 1.18.0
  - notes: 4.10.0
  - notify_push: 0.6.12
  - oauth2: 1.17.0
  - password_policy: 1.19.0
  - privacy: 1.13.0
  - provisioning_api: 1.19.0
  - recommendations: 2.1.0
  - related_resources: 1.4.0
  - serverinfo: 1.19.0
  - settings: 1.12.0
  - sharebymail: 1.19.0
  - support: 1.12.0
  - systemtags: 1.19.0
  - tasks: 0.16.0
  - text: 3.10.0
  - theming: 2.4.0
  - twofactor_backupcodes: 1.18.0
  - twofactor_totp: 11.0.0-dev
  - user_status: 1.9.0
  - viewer: 2.3.0
  - workflowengine: 2.11.0

Nextcloud Signing status

No errors have been found.

Nextcloud Logs

See bug description, please.

Additional info

Server Configuration: Cpu: 4 RAM: 8 GB SSD: 160GB Primary Volume: S3 External Storage Nextcloud Server: 29.0.2.2 (note: Official Nextcloud AIO) Desktop macOS: 3.13.0git (build 22490)

sl-lebrit commented 1 month ago

the problem seems to appear only when synchronising with macOS Nextcloud.app --3.13.0 git (build 22490) in my case-- don't know if even Windows is affected bc I don't have Windows PCs

When I synchronise a folder containing .mov files and images, the synchronisation creates the folder and sub-folders as usual and then loads the files until, after a .mov file, an image file must be synchronised. The file is not loaded and the synchronisation of the entire folder is skipped, leaving the subfolders empty.

If, on the other hand, I perform an upload of the same folder via the browser, everything is fine.
There is still much to be done with Nextcloud Desktop.

Sincerely, Ste.

joshtrichards commented 1 week ago

PHP: Optional parameter $userId declared before required parameter $path is implicitly treated as a required parameter at /var/www/html/custom_apps/deck/lib/Service/ConfigService.php#234

This one is in the Deck app and already fixed in nextcloud/deck#5794

PHP: Trying to access array offset on value of type null at /var/www/html/3rdparty/wapmorgan/mp3info/src/Mp3Info.php#397 PHP: Undefined array key 4 at /var/www/html/3rdparty/wapmorgan/mp3info/src/Mp3Info.php#397

These are fixed in #46276

PHP: Allowed memory size of 536870912 bytes exhausted (tried to allocate 2097184 bytes) at /var/www/html/3rdparty/guzzlehttp/psr7/src/Stream.php#257

Without further context (surrounding log entries and, ideally, exactly what triggers it, this one is just a generic PHP error).

CRON: DbalException An exception occurred while executing a query: SQLSTATE[HY000]: General error: 7 no connection to the server

This one is a connection error to your database. It's not a bug, but some sort of local infrastructure issue. Maybe the container was restarting or something?

getimagesize(): Corrupt JPEG data: 843 extraneous bytes before marker at /var/www/html/lib/private/legacy/OC_Image.php#697

Fix pending (we'll try to avoid logging when we notice corrupt image data, other than at the debug level). Though the underlying root cause is something weird about one of your images.

nextcloud / server