nextcloud / maps

🌍🌏🌎 The whole world fits inside your cloud!
https://apps.nextcloud.com/apps/maps
GNU Affero General Public License v3.0
498 stars 88 forks source link

Photos amount dropped from 2k+ to only 1 by occ maps:scan-photos command #651

Closed GAS85 closed 3 years ago

GAS85 commented 3 years ago

Hi, I was suffering that no photos being on the map since 01.01.2021, so I performed occ maps:scan-photos and all looks good, 40k photos being scanned for my user and also for all different users too. Now, when I visit UI, I see only 1 Photo, also on the map it is only 1 shown. изображение

Only 1 error seen many times:

{"reqId":"F2YhcCGGPvT20OYmaGow","level":3,"time":"2021-10-01T22:19:09+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":{"Exception":"Error","Message":"Division by zero at /var/www/nextcloud/apps/maps/lib/Service/PhotofilesService.php#413","Code":0,"Trace":[{"file":"/var/www/nextcloud/apps/maps/lib/Service/PhotofilesService.php","line":413,"function":"onError","class":"OC\\Log\\ErrorHandler","type":"::"},{"file":"/var/www/nextcloud/apps/maps/lib/Service/PhotofilesService.php","line":264,"function":"getExif","class":"OCA\\Maps\\Service\\PhotofilesService","type":"->"},{"file":"/var/www/nextcloud/apps/maps/lib/BackgroundJob/AddPhotoJob.php","line":56,"function":"addPhotoNow","class":"OCA\\Maps\\Service\\PhotofilesService","type":"->"},{"file":"/var/www/nextcloud/lib/public/BackgroundJob/Job.php","line":80,"function":"run","class":"OCA\\Maps\\BackgroundJob\\AddPhotoJob","type":"->"},{"file":"/var/www/nextcloud/lib/public/BackgroundJob/QueuedJob.php","line":48,"function":"execute","class":"OCP\\BackgroundJob\\Job","type":"->"},{"file":"/var/www/nextcloud/cron.php","line":128,"function":"execute","class":"OCP\\BackgroundJob\\QueuedJob","type":"->"}],"File":"/var/www/nextcloud/lib/private/Log/ErrorHandler.php","Line":92,"CustomMessage":"--"},"userAgent":"--","version":"21.0.4.1","id":"61578ffe2a24a"}

DB size grows for 3 MB after rescan: изображение


Server configuration detail

Operating system: Linux 5.4.0-86-generic #97-Ubuntu SMP Fri Sep 17 19:19:40 UTC 2021 x86_64

Webserver: Apache (fpm-fcgi)

Database: mysql 10.3.31

PHP version: 7.4.24

Modules loaded: Core, date, libxml, openssl, pcre, zlib, filter, hash, Reflection, SPL, session, standard, sodium, cgi-fcgi, mysqlnd, PDO, xml, apcu, bcmath, bz2, calendar, ctype, curl, dom, mbstring, FFI, fileinfo, ftp, gd, gettext, gmp, iconv, igbinary, imagick, intl, json, exif, mysqli, pdlib, pdo_mysql, pdo_sqlite, apc, posix, readline, redis, shmop, SimpleXML, sockets, sqlite3, sysvmsg, sysvsem, sysvshm, tokenizer, xmlreader, xmlwriter, xsl, zip, Phar, Zend OPcache

Nextcloud version: 21.0.4 - 21.0.4.1

Updated from an older Nextcloud/ownCloud or fresh install:

Where did you install Nextcloud from: unknown

Signing status Array ( )
List of activated apps ``` Enabled: - accessibility: 1.7.0 - activity: 2.14.3 - admin_audit: 1.11.0 - audioplayer: 3.2.2 - bruteforcesettings: 2.2.0 - calendar: 2.3.4 - camerarawpreviews: 0.7.12 - checksum: 1.1.2 - cloud_federation_api: 1.4.0 - comments: 1.11.0 - contacts: 4.0.3 - contactsinteraction: 1.2.0 - cospend: 1.3.7 - data_request: 1.8.0 - dav: 1.17.1 - deck: 1.4.5 - drawio: 1.0.1 - external: 3.8.2 - extract: 1.3.2 - facerecognition: 0.8.3 - federatedfilesharing: 1.11.0 - files: 1.16.0 - files_automatedtagging: 1.11.0 - files_downloadactivity: 1.11.1 - files_external: 1.12.0 - files_mindmap: 0.0.25 - files_pdfviewer: 2.1.0 - files_retention: 1.10.2 - files_rightclick: 1.0.0 - files_sharing: 1.13.1 - files_trashbin: 1.11.0 - files_versions: 1.14.0 - files_videoplayer: 1.10.0 - firstrunwizard: 2.10.0 - forms: 2.3.0 - gpxedit: 0.0.14 - gpxmotion: 0.1.0 - gpxpod: 4.2.8 - keeweb: 0.6.6 - logreader: 2.6.0 - lookup_server_connector: 1.9.0 - mail: 1.10.5 - maps: 0.1.9 - nextcloud_announcements: 1.10.0 - notes: 4.1.1 - notifications: 2.9.0 - oauth2: 1.9.0 - ocdownloader: 1.7.12 - password_policy: 1.11.0 - phonetrack: 0.6.9 - photos: 1.3.0 - polls: 3.2.0 - previewgenerator: 3.1.1 - privacy: 1.5.0 - provisioning_api: 1.11.0 - radio: 1.0.3 - recognize: 1.4.2 - recommendations: 1.0.0 - serverinfo: 1.11.0 - settings: 1.3.0 - sharebymail: 1.11.0 - side_menu: 1.27.2 - spreed: 11.3.2 - support: 1.4.0 - survey_client: 1.9.0 - systemtags: 1.11.0 - text: 3.2.0 - theming: 1.12.0 - twofactor_backupcodes: 1.10.0 - twofactor_totp: 6.1.0 - unsplash: 1.2.3 - updatenotification: 1.11.0 - user_status: 1.1.1 - video_converter: 1.0.3 - viewer: 1.5.0 - weather: 1.7.5 - workflowengine: 2.3.0 Disabled: - dashboard - encryption - federation - files_antivirus - flowupload - impersonate - integration_dropbox - user_ldap - weather_status ```
Configuration (config/config.php) ``` { "instanceid": "***REMOVED SENSITIVE VALUE***", "passwordsalt": "***REMOVED SENSITIVE VALUE***", "secret": "***REMOVED SENSITIVE VALUE***", "trusted_domains": [ ""***REMOVED SENSITIVE VALUE***",", ""***REMOVED SENSITIVE VALUE***",", ""***REMOVED SENSITIVE VALUE***"," ], "datadirectory": "***REMOVED SENSITIVE VALUE***", "overwrite.cli.url": "https:\/\/"***REMOVED SENSITIVE VALUE***",", "dbtype": "mysql", "version": "21.0.4.1", "dbname": "***REMOVED SENSITIVE VALUE***", "dbhost": "***REMOVED SENSITIVE VALUE***", "dbport": "", "dbtableprefix": "oc_", "mysql.utf8mb4": true, "dbuser": "***REMOVED SENSITIVE VALUE***", "dbpassword": "***REMOVED SENSITIVE VALUE***", "installed": true, "filesystem_check_changes": 0, "filelocking.enabled": true, "memcache.local": "\\OC\\Memcache\\APCu", "memcache.locking": "\\OC\\Memcache\\Redis", "memcache.distributed": "\\OC\\Memcache\\Redis", "redis": { "host": "***REMOVED SENSITIVE VALUE***", "port": 0, "timeout": 1.5 }, "default_phone_region": "DE", "mail_smtpmode": "smtp", "mail_smtpauthtype": "LOGIN", "mail_from_address": "***REMOVED SENSITIVE VALUE***", "mail_domain": "***REMOVED SENSITIVE VALUE***", "maintenance": false, "theme": "", "logfile": "\/var\/nextcloud\/data\/nextcloud.log", "loglevel": 0, "trashbin_retention_obligation": "14, auto", "versions_retention_obligation": "14, auto", "data-fingerprint": "7be51475e95ea13b254cd880319d98ec", "enable_previews": true, "enabledPreviewProviders": [ "OC\\Preview\\PNG", "OC\\Preview\\JPEG", "OC\\Preview\\GIF", "OC\\Preview\\BMP", "OC\\Preview\\XBitmap", "OC\\Preview\\Movie", "OC\\Preview\\PDF", "OC\\Preview\\MP3", "OC\\Preview\\TXT", "OC\\Preview\\MarkDown" ], "preview_max_x": 1920, "preview_max_y": 1080, "jpeg_quality": 90, "auth.bruteforce.protection.enabled": true, "simpleSignUpLink.shown": false, "mail_smtpsecure": "tls", "mail_smtpauth": 1, "mail_smtphost": "***REMOVED SENSITIVE VALUE***", "mail_smtpport": "587", "mail_smtpname": "***REMOVED SENSITIVE VALUE***", "mail_smtppassword": "***REMOVED SENSITIVE VALUE***", "twofactor_enforced": true, "twofactor_enforced_groups": [ "admin" ], "twofactor_enforced_excluded_groups": [], "has_rebuilt_cache": true, "updater.release.channel": "stable", "app_install_overwrite": [ "keeweb", "radio", "gpxedit" ], "mail_sendmailmode": "smtp" } ```

External storages: yes

Encryption: no

User-backends:

Browser: Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:92.0) Gecko/20100101 Firefox/92.0

GAS85 commented 3 years ago

Now I see over 4k photos on the map, seems scan job not add them immediately (?) to the map, but after few hours after it was finished.