YoSiJo commented 5 years ago

Steps to reproduce

Run ./occ suspiciouslogin:predict <uid> <ip>

In ModelPersistenceService.php line 91:

  No models found  

In QBMapper.php line 248:

  Did expect one result but found none when executing: query "SELECT * FROM `*PREFIX*suspicious_login_model` ORDER BY `created_at` desc LIMIT 1";  

suspiciouslogin:predict <uid> <ip> [<model>]

Expected behaviour

No idea, but not this.

Actual behaviour

In ModelPersistenceService.php line 91:

  No models found  

In QBMapper.php line 248:

  Did expect one result but found none when executing: query "SELECT * FROM `*PREFIX*suspicious_login_model` ORDER BY `created_at` desc LIMIT 1";  

suspiciouslogin:predict <uid> <ip> [<model>]

Server configuration detail

Operating system: Linux 5.0.21-1-pve #1 SMP PVE 5.0.21-2 (Wed, 28 Aug 2019 15:12:18 +0200) x86_64

Webserver: Apache/2.4.38 (Debian) (apache2handler)

Database: mysql 10.3.17

PHP version:

7.3.4-2 Modules loaded: Core, date, libxml, openssl, pcre, zlib, filter, hash, Reflection, SPL, session, sodium, standard, apache2handler, pdlib, mysqlnd, PDO, xml, apcu, bz2, calendar, ctype, curl, dom, mbstring, fileinfo, ftp, gd, gettext, gmp, iconv, igbinary, imagick, imap, intl, json, exif, msgpack, mysqli, pdo_mysql, pdo_pgsql, pdo_sqlite, pgsql, apc, posix, readline, redis, shmop, SimpleXML, smbclient, sockets, sqlite3, ssh2, sysvmsg, sysvsem, sysvshm, tokenizer, wddx, xmlreader, xmlrpc, xmlwriter, xsl, zip, Phar, memcached, libsmbclient, Zend OPcache

Nextcloud version: 16.0.4 - 16.0.4.1

Updated from an older Nextcloud/ownCloud or fresh install:

Where did you install Nextcloud from: unknown

Signing status

List of activated apps

``` Enabled: - accessibility: 1.2.0 - activity: 2.9.1 - admin_audit: 1.6.0 - admin_notifications: 1.0.2 - announcementcenter: 3.5.1 - apporder: 0.7.1 - audioplayer: 2.8.4 - audioplayer_editor: 0.1.0 - bookmarks: 2.1.1 - calendar: 1.7.1 - camerarawpreviews: 0.7.0 - carnet: 0.17.0 - checksum: 0.4.3 - circles: 0.17.7 - cloud_federation_api: 0.2.0 - cms_pico: 0.9.8 - comments: 1.6.0 - contacts: 3.1.3 - cospend: 0.1.0 - dashboard: 6.0.0 - data_request: 1.3.0 - dav: 1.9.2 - deck: 0.6.6 - dicomviewer: 1.2.0 - drawio: 0.9.3 - drop_account: 0.1.0 - dropit: 0.2.1 - encryption: 2.4.0 - event_update_notification: 0.3.4 - external: 3.3.0 - extract: 1.2.0 - facerecognition: 0.5.7 - federatedfilesharing: 1.6.0 - federation: 1.6.0 - files: 1.11.0 - files_3d: 0.1.0 - files_antivirus: 2.1.1 - files_automatedtagging: 1.6.0 - files_clipboard: 0.7.1 - files_downloadactivity: 1.5.0 - files_ebookreader: 0.0.1 - files_external: 1.7.0 - files_linkeditor: 1.0.10 - files_markdown: 2.1.0 - files_mindmap: 0.0.15 - files_pdfviewer: 1.5.0 - files_readmemd: 1.1.1 - files_retention: 1.5.1 - files_rightclick: 0.15.1 - files_sharing: 1.8.0 - files_texteditor: 2.8.0 - files_trackdownloads: 1.5.0 - files_trashbin: 1.6.0 - files_versions: 1.9.0 - files_videoplayer: 1.5.0 - firstrunwizard: 2.5.0 - flowupload: 0.1.2 - forms: 1.0.3 - gallery: 18.3.0 - gpxedit: 0.0.11 - gpxmotion: 0.0.9 - gpxpod: 4.0.5 - groupfolders: 4.1.0 - hsts: 0.3.0 - issuetemplate: 0.5.0 - keeweb: 0.5.1 - logreader: 2.1.0 - lookup_server_connector: 1.4.0 - mail: 0.17.0 - maps: 0.1.2 - metadata: 0.9.0 - mindmaps: 0.1.0 - music: 0.10.1 - myscan: 0.0.1 - news: 13.1.6 - nextcloud_announcements: 1.5.0 - notes: 3.0.2 - notifications: 2.4.1 - oauth2: 1.4.2 - ocdownloader: 1.7.2 - ocr: 4.4.6 - ocsms: 2.1.3 - ownpad: 0.6.13 - passman: 2.3.2 - password_policy: 1.6.0 - passwords: 2019.9.0 - phonetrack: 0.5.2 - piwik: 0.5.3 - polls: 0.10.2 - preferred_providers: 1.4.0 - previewgenerator: 2.1.0 - printer: 0.0.1 - privacy: 1.0.0 - privatedata: 1.0.1 - provisioning_api: 1.6.0 - quickaccesssorting: 1.0.1 - quicknotes: 0.1.9 - quota_warning: 1.5.0 - radio: 0.6.5 - ransomware_protection: 1.4.0 - recommendations: 0.4.0 - registration: 0.4.7 - scanner: 0.1.4 - serverinfo: 1.6.0 - sharebymail: 1.6.0 - sharelisting: 0.2.0 - sharerenamer: 2.7.1 - sharingpath: 0.0.1 - social: 0.2.101 - socialsharing_diaspora: 1.0.4 - socialsharing_email: 1.0.5 - socialsharing_facebook: 1.0.4 - socialsharing_googleplus: 1.0.4 - socialsharing_twitter: 1.0.4 - spreed: 6.0.4 - survey_client: 1.4.0 - suspicious_login: 1.0.0 - systemtags: 1.6.0 - tasks: 0.11.2 - telephoneprovider: 1.0.2 - terms_of_service: 1.2.2 - text: 1.0.2 - theming: 1.7.0 - twofactor_admin: 0.4.1 - twofactor_backupcodes: 1.5.0 - twofactor_email: 1.0.0 - twofactor_gateway: 0.14.1 - twofactor_nextcloud_notification: 1.1.2 - twofactor_totp: 3.0.1 - updatenotification: 1.6.0 - uploaddetails: 0.1.1 - user_usage_report: 1.1.2 - video_converter: 0.1.0 - viewer: 1.1.0 - workflow_pdf_converter: 1.1.0 - workflowengine: 1.6.0 Disabled: - end_to_end_encryption - files_accesscontrol - files_inotify - files_snapshots - folderplayer - githubmergetracker - ojsxc - ownbackup - ransomware_detection - sociallogin - support - theming_customcss - twofactor_yubikey - user_ldap - w2g2 - weather - workflow_script ```

Configuration (config/config.php)

``` { "log_type": "syslog", "logfile": "", "loglevel": 0, "instanceid": "***REMOVED SENSITIVE VALUE***", "passwordsalt": "***REMOVED SENSITIVE VALUE***", "secret": "***REMOVED SENSITIVE VALUE***", "trusted_proxies": "***REMOVED SENSITIVE VALUE***", "trusted_domains": [ "nc.waimanu.io" ], "datadirectory": "***REMOVED SENSITIVE VALUE***", "overwrite.cli.url": "https:\/\/nc.waimanu.io", "overwritehost": "nc.waimanu.io", "overwriteprotocol": "https", "overwritewebroot": "", "dbtype": "mysql", "version": "16.0.4.1", "dbname": "***REMOVED SENSITIVE VALUE***", "dbhost": "***REMOVED SENSITIVE VALUE***", "dbport": "", "dbtableprefix": "oc_", "dbuser": "***REMOVED SENSITIVE VALUE***", "dbpassword": "***REMOVED SENSITIVE VALUE***", "installed": true, "memcache.local": "\\OC\\Memcache\\APCu", "memcache.distributed": "\\OC\\Memcache\\Redis", "memcache.locking": "\\OC\\Memcache\\Redis", "memcached_servers": [ [ "127.0.0.1", 11211 ] ], "redis": { "host": "***REMOVED SENSITIVE VALUE***", "port": 6379 }, "htaccess.RewriteBase": "\/", "mail_smtpmode": "smtp", "mail_smtpauthtype": "LOGIN", "mail_smtpsecure": "tls", "mail_from_address": "***REMOVED SENSITIVE VALUE***", "mail_domain": "***REMOVED SENSITIVE VALUE***", "mail_smtpauth": 1, "mail_smtphost": "***REMOVED SENSITIVE VALUE***", "mail_smtpport": "25", "mail_smtpname": "***REMOVED SENSITIVE VALUE***", "mail_smtppassword": "***REMOVED SENSITIVE VALUE***", "theme": "", "mysql.utf8mb4": true, "log_rotate_size": 1073741824, "logtimezone": "Europe\/Berlin", "updater.release.channel": "stable", "maintenance": false, "trashbin_retention_obligation": "30,auto", "versions_retention_obligation": "365,auto", "enable_previews": true, "enabledPreviewProviders": [ "OC\\Preview\\PNG", "OC\\Preview\\JPEG", "OC\\Preview\\GIF", "OC\\Preview\\BMP", "OC\\Preview\\XBitmap", "OC\\Preview\\Movie", "OC\\Preview\\PDF", "OC\\Preview\\MP3", "OC\\Preview\\TXT", "OC\\Preview\\MarkDown", "OC\\Preview\\Image", "OC\\Preview\\Photoshop", "OC\\Preview\\TIFF", "OC\\Preview\\SVG", "OC\\Preview\\OpenDocument" ], "ldapIgnoreNamingRules": false, "ldapProviderFactory": "OCA\\User_LDAP\\LDAPProviderFactory", "data-fingerprint": "14f9373638db7e4c620b53251289ac68", "preview_libreoffice_path": "\/usr\/bin\/libreoffice", "filesystem_check_changes": 1, "has_rebuilt_cache": true, "app_install_overwrite": [ "files_downloadactivity", "admin_notifications", "mindmaps", "privatedata", "files_clipboard", "githubmergetracker", "folderplayer", "documents", "defaultgroup", "myscan", "twofactor_email" ] } ```

Are you using external storage, if yes which one: local/smb/sftp/...

Are you using encryption: false

Are you using an external user-backend, if yes which one: LDAP/ActiveDirectory/Webdav/...

Client configuration

Browser: Mozilla/5.0 (X11; Linux x86_64; rv:69.0) Gecko/20100101 Firefox/69.0

Operating system: Arch Linux

Logs

Web server error log

``` 2019-09-16T23:48:46.610 819698600530 apache2.service Nextcloud[12700] CRITICAL {suspicious_login} No models found. Can't load latest 2019-09-16T23:48:46.610 819698601274 apache2.service Nextcloud[12700] WARNING {suspicious_login} Could not predict suspiciousness: No models found ```

Nextcloud log

``` In ModelPersistenceService.php line 91: No models found In QBMapper.php line 248: Did expect one result but found none when executing: query "SELECT * FROM `*PREFIX*suspicious_login_model` ORDER BY `created_at` desc LIMIT 1"; suspiciouslogin:predict [] ```

Browser log

ChristophWurst commented 5 years ago

Hi,

the app has not trained any NN models on your instance yet, hence it can't predict on suspiciousness of IP addresses. Once the 60 days are over it will work.

Cheers

llucax commented 4 years ago

I have a similar issue with model 143. I can't find a model 143 in /appdata_xxxx/suspicious_login/models/143., but there is a 144 and 145.

I had some out of space issues just a few days ago, and I have the suspicion (pun intended) that it might have happened that the model had to be created in the disk but couldn't because of the lack of space (inodes in reality).

Could this have happened? And if so, would it be OK to remove the model from the DB (from table suspicious_login_model, something else?) or to just copy another model file as a hack? Or the non-existence of that file is normal and I should wait 60 days and that should be all?

In any case is not ideal to have the logs flooded with a warning that is not really a warning if it's expected behavior, so in any case I think there is something that can be improved here.

Since my error is slightly different, here is the output:

$ occ suspiciouslogin:predict llucax 192.168.10.10 143

In ModelPersistenceService.php line 138:

  Could not load model 143

In Root.php line 205:

  /appdata_xxxxxx/suspicious_login/models/143

suspiciouslogin:predict [--v6] [--] <uid> <ip> [<model>]

(the xxxxxx is the masked ID, not sure if it would be a security or privacy issue if I share it)

ChristophWurst commented 4 years ago

please open a new ticket