cryptomator / cryptofs

Java Filesystem Provider with integrated encryption
GNU Affero General Public License v3.0
94 stars 35 forks source link

Error During Migration #93

Closed poxeron closed 2 years ago

poxeron commented 4 years ago

Description during move some date I got asked to migrate the Vault which I wanted to open. I started the migration (Vault is big!) the following error appears:

18:58:13.080 [App Background Thread 004] INFO  o.c.c.migration.v7.MigratingVisitor - MOVED F:\AmazonDrive\Crypto\d\ZU\UEY3Y54RAUG356MR3OMSPPW2NE3VO2\URDOKBENFOTXPXGZ4SZCSQOE42YB7SJTGZPLX2ICICBWNNTUMS52SZE4QETDI=== to F:\AmazonDrive\Crypto\d\ZU\UEY3Y54RAUG356MR3OMSPPW2NE3VO2\pEblBI0rp3fc2eSyKUHE5rAfyTM2XrvpAkCDZrZ0ZLupZJyBJjQ=.c9r
18:58:13.082 [App Background Thread 004] INFO  o.c.c.migration.v7.MigratingVisitor - MOVED F:\AmazonDrive\Crypto\d\ZU\UEY3Y54RAUG356MR3OMSPPW2NE3VO2\WD2RHPQB3DVXWWXHR6OA767KN4XH7PXF.lng to F:\AmazonDrive\Crypto\d\ZU\UEY3Y54RAUG356MR3OMSPPW2NE3VO2\txLRn7_51G6tLnVkKSSQ4RZ5kWg=.c9s\contents.c9r
18:58:13.083 [App Background Thread 004] INFO  o.c.c.migration.v7.MigratingVisitor - MOVED F:\AmazonDrive\Crypto\d\ZU\UEY3Y54RAUG356MR3OMSPPW2NE3VO2\WFWJK76V4JDIZ6VXIVFOJ5BAX7QIYRNT.lng to F:\AmazonDrive\Crypto\d\ZU\UEY3Y54RAUG356MR3OMSPPW2NE3VO2\eOanbvF7zcyMIUduIlZuU41cy4DO_0Qn80MT3xUrgGVoD3F_4GzWxolUJvvXqfr5J4zD513R52OVE1us_vDjqUtXr1W-n6yVgA54vpXhH47NIyhnKnQmYlBY8lzE8xo0syw=.c9r
18:58:13.084 [App Background Thread 004] INFO  o.c.c.migration.v7.MigratingVisitor - MOVED F:\AmazonDrive\Crypto\d\ZU\UEY3Y54RAUG356MR3OMSPPW2NE3VO2\XV2BBXG2NEE56IUSTGEC7TJPDM24VZPLEKAMIWDXC4AS476UNOHWES7HJEH2JMMPHAP4QE53OS7IH7C5H3CHE5A= to F:\AmazonDrive\Crypto\d\ZU\UEY3Y54RAUG356MR3OMSPPW2NE3VO2\vXQQ3NppCd8ikpmIL80vGzXK5esigMRYdxcBLn_Ua49iS-dJD6SxjzgfyBO7dL6D_F0-xHJ0.c9r
18:58:13.084 [App Background Thread 004] INFO  o.c.c.migration.v7.MigratingVisitor - MOVED F:\AmazonDrive\Crypto\d\ZU\UEY3Y54RAUG356MR3OMSPPW2NE3VO2\Y7ABQWAXYEFCZSLQ77MIK5VA3OIF7UL6.lng to F:\AmazonDrive\Crypto\d\ZU\UEY3Y54RAUG356MR3OMSPPW2NE3VO2\2kZT9pAYh72GG9rWnLXkSFGsHQbNQOp00eZv4ORZTaUqcvR3XNV_bZRP_p7jzM2KxOxSdZXRJ8ljXCB-Kn1AeDlPJ9HIonh71ubCO3BrCRkmEUKJK1UmLl4=.c9r
18:58:13.085 [App Background Thread 004] INFO  o.c.c.migration.v7.MigratingVisitor - MOVED F:\AmazonDrive\Crypto\d\ZU\UEY3Y54RAUG356MR3OMSPPW2NE3VO2\ZJF2VGSHITZGEWVXZ4EID2APIDVXAFMZEDFJIZZSICLSM5OHQRCBZ6NEUQEKA3ILX6VACWL4WKVRBKTLKFU5TGSNZAZDGJAB34YTXHTLI4JUKMHACA====== to F:\AmazonDrive\Crypto\d\ZU\UEY3Y54RAUG356MR3OMSPPW2NE3VO2\ykuqmkdE8mJat88IgegPQOtwFZkgypRnMkCXJnXHhEQc-aSkCKBtC7-qAVl8sqsQqmtRadmaTcgyMyQB3zE7nmtHE0Uw4BA=.c9r
18:58:13.086 [App Background Thread 004] INFO  o.c.c.migration.v7.MigratingVisitor - MOVED F:\AmazonDrive\Crypto\d\ZU\UEY3Y54RAUG356MR3OMSPPW2NE3VO2\ZXB4MH2RXU2WXZCWJS3JBEJYBBPS6RPRJLC6C6MCIO5KAIVBFLWTBCUGK4WJ5SGXMCFQ==== to F:\AmazonDrive\Crypto\d\ZU\UEY3Y54RAUG356MR3OMSPPW2NE3VO2\zcPGH1G9NWvkVky2kJE4CF8vRfFKxeF5gkO6oCKhKu0wioZXLJ7I12CL.c9r
18:58:13.086 [App Background Thread 004] INFO  o.c.c.migration.v7.MigratingVisitor - MOVED F:\AmazonDrive\Crypto\d\ZX\J3XFMUCY7ZXN242YPOGPJ4PNLHYKJW\WGLHOYJILFMVMKCPA2UHS634KBENCUBWP5V2KT7O3EECLHT74YZOVMHQ76PFWZDG6XPRJ5OJASRII=== to F:\AmazonDrive\Crypto\d\ZX\J3XFMUCY7ZXN242YPOGPJ4PNLHYKJW\sZZ3YShZWVYoTwaoeXt8UEjRUDZ_a6VP7tkIJZ5_5jLqsPD_nltkZvXfFPXJBKKE.c9r
18:58:13.088 [App Background Thread 004] INFO  o.c.c.migration.v7.MigratingVisitor - MOVED F:\AmazonDrive\Crypto\d\ZY\OJPZGWNMI4DWWMW526XQBNGN6LOE5J\02GZDGM7I3ZXOK726C73LEB6P3LKUNJAOZNGE3WQ= to F:\AmazonDrive\Crypto\d\ZY\OJPZGWNMI4DWWMW526XQBNGN6LOE5J\0bIzM-jebuV_Xhf2sgfP2tVGpA7LTE3a.c9r\dir.c9r
18:58:13.089 [App Background Thread 004] INFO  o.c.c.migration.v7.MigratingVisitor - MOVED F:\AmazonDrive\Crypto\d\ZY\OJPZGWNMI4DWWMW526XQBNGN6LOE5J\0R7LCLA2YIJLO3QT32WP62CSA6EWD4CAC to F:\AmazonDrive\Crypto\d\ZY\OJPZGWNMI4DWWMW526XQBNGN6LOE5J\j9Ylg1hCVu3Ce9Wf7QpA8Sw-CAI=.c9r\dir.c9r
18:58:13.090 [App Background Thread 004] INFO  o.c.c.migration.v7.MigratingVisitor - MOVED F:\AmazonDrive\Crypto\d\ZY\OJPZGWNMI4DWWMW526XQBNGN6LOE5J\0YPKZZOW42ZW5NJQ3K3Q33QZCIRG7LPCELQNXNHI= to F:\AmazonDrive\Crypto\d\ZY\OJPZGWNMI4DWWMW526XQBNGN6LOE5J\w9WcutzWbdamG1bhvcMiRE31vERcG3ad.c9r\dir.c9r
18:58:14.639 [App Background Thread 004] DEBUG o.c.c.common.ReseedingSecureRandom - Seeding CSPRNG with 55 bytes...
18:58:14.640 [App Background Thread 004] DEBUG o.c.c.common.ReseedingSecureRandom - Seeded CSPRNG.
18:58:14.921 [App Background Thread 004] INFO  o.c.c.migration.v7.Version7Migrator - Updated masterkey.
18:58:14.922 [App Background Thread 004] INFO  o.c.c.migration.v7.Version7Migrator - Upgraded F:\AmazonDrive\Crypto from version 6 to version 7.
18:58:14.926 [JavaFX Application Thread] INFO  o.c.u.m.MigrationRunController - Migration of 'Crypto' succeeded.
18:58:14.926 [JavaFX Application Thread] DEBUG o.c.common.vaults.VaultStats - stop recording stats
18:58:14.927 [JavaFX Application Thread] DEBUG o.c.ui.launcher.AppLifecycleListener - Allow quitting without prompt: true
18:58:49.640 [JavaFX Application Thread] DEBUG org.cryptomator.common.CommonsModule - Starting App Background Thread 005
18:58:49.640 [JavaFX Application Thread] DEBUG o.cryptomator.ui.fxapp.FxApplication - Showing UnlockWindow for Crypto
18:58:49.641 [JavaFX Application Thread] DEBUG o.c.common.vaults.VaultStats - stop recording stats
18:58:49.642 [JavaFX Application Thread] DEBUG o.c.ui.launcher.AppLifecycleListener - Allow quitting without prompt: false
18:58:53.269 [JavaFX Application Thread] TRACE o.c.ui.unlock.UnlockController - UnlockController.unlock()
18:58:53.270 [App Background Thread 005] DEBUG org.cryptomator.common.vaults.Vault - Determining file name length limitations...
18:58:53.293 [App Background Thread 005] INFO  org.cryptomator.common.vaults.Vault - Storing file name length limit of 220
18:58:53.314 [App Background Thread 005] DEBUG o.cryptomator.cryptofs.ReadonlyFlag - Vault opened for read and write.
18:58:53.631 [App Background Thread 005] INFO  com.dokany.java.DokanyDriver - Dokany version: 140
18:58:53.631 [App Background Thread 005] INFO  com.dokany.java.DokanyDriver - Dokany driver version: 400
18:58:53.632 [App Background Thread 005] DEBUG o.c.frontend.dokany.MountFactory - Mounting on G:\: ...
18:58:53.632 [App Background Thread 005] DEBUG org.cryptomator.common.CommonsModule - Starting App Background Thread 006
18:58:53.817 [Thread-15] TRACE o.c.frontend.dokany.ReadWriteAdapter - zwCreateFile() is called for / with the following parameters:
    CreateDisposition -- OPEN_EXISTING
    createOptions -- EnumIntegerSet(elements=[FILE_SYNCHRONOUS_IO_NONALERT, FILE_NON_DIRECTORY_FILE, FILE_COMPLETE_IF_OPLOCKED])
    accessMasks -- EnumIntegerSet(elements=[SYNCHRONIZE])
    fileAccessMasks -- EnumIntegerSet(elements=[])
    fileAttributes -- EnumIntegerSet(elements=[]).
18:58:53.822 [Thread-15] DEBUG o.c.frontend.dokany.ReadWriteAdapter - Ressource / is a Directory and cannot be opened as a file.
18:58:53.826 [Thread-16] TRACE o.c.frontend.dokany.ReadWriteAdapter - zwCreateFile() is called for / with the following parameters:
    CreateDisposition -- OPEN_EXISTING
    createOptions -- EnumIntegerSet(elements=[])
    accessMasks -- EnumIntegerSet(elements=[SYNCHRONIZE])
    fileAccessMasks -- EnumIntegerSet(elements=[])
    fileAttributes -- EnumIntegerSet(elements=[]).
18:58:53.829 [Thread-16] TRACE o.c.frontend.dokany.ReadWriteAdapter - Try to open / as Directory.
18:58:53.834 [Thread-16] TRACE o.c.frontend.dokany.ReadWriteAdapter - (1) / opened successful with handle 1.
18:58:53.836 [Thread-17] TRACE o.c.frontend.dokany.ReadWriteAdapter - (1) getFileInformation() is called for /.
18:58:53.837 [Thread-17] TRACE o.c.frontend.dokany.ReadWriteAdapter - (1) Filesize of / is 0.
18:58:53.844 [Thread-17] TRACE o.c.frontend.dokany.ReadWriteAdapter - (1) File Information successful read from /.
18:58:53.845 [Thread-18] TRACE o.c.frontend.dokany.ReadWriteAdapter - (1) getFileInformation() is called for /.
18:58:53.846 [Thread-18] TRACE o.c.frontend.dokany.ReadWriteAdapter - (1) Filesize of / is 0.
18:58:53.847 [Thread-18] TRACE o.c.frontend.dokany.ReadWriteAdapter - (1) File Information successful read from /.
18:58:53.848 [Thread-19] TRACE o.c.frontend.dokany.ReadWriteAdapter - (1) cleanup() is called for /.
18:58:53.849 [Thread-20] TRACE o.c.frontend.dokany.ReadWriteAdapter - (1) closeFile() is called for /.
18:58:53.855 [App Background Thread 006] TRACE o.c.frontend.dokany.ReadWriteAdapter - mounted() is called.
18:58:54.293 [App Scheduled Executor 02] DEBUG o.c.common.settings.SettingsProvider - Attempting to save settings to C:\Users\ne_id\AppData\Roaming\Cryptomator\settings.json
18:58:54.296 [App Scheduled Executor 02] INFO  o.c.common.settings.SettingsProvider - Settings saved to C:\Users\ne_id\AppData\Roaming\Cryptomator\settings.json
18:58:56.635 [App Background Thread 005] TRACE o.cryptomator.frontend.dokany.Mount - Mounting still in progress.
18:58:56.635 [App Background Thread 005] DEBUG o.c.frontend.dokany.MountFactory - Mounted directory at G:\ successfully.
18:58:56.635 [App Background Thread 005] INFO  o.c.ui.unlock.UnlockWorkflow - Unlock of 'Crypto' succeeded.
18:58:56.646 [JavaFX Application Thread] DEBUG o.c.common.vaults.VaultStats - start recording stats

System Setup Operating system and version:windows 10 Professional Cryptomator version:1.5.0 and now 1.5.8 Drive: Dokany

Steps to Reproduce ### No option to reproduce . Drive is empty, but files exist

Expected Behavior Data is visible

Actual Behavior data moved with errors , Vault migration throws error

tobihagemann commented 4 years ago

You mentioned that there was an error but it looks like that the migration was successful:

Migration of 'Crypto' succeeded.

This reminds me of a case that we had with iCloud Drive (but you're apparently using Amazon Drive): https://community.cryptomator.org/t/corrupt-unable-to-open-folders/6645

I'd like to suggest to the same for debugging purposes: Please open cmd and run these commands.

cd "F:\AmazonDrive\Crypto"
powershell -command "iex \"tree /f\" > \"tree.txt\""

After that, there will be a tree.txt inside your vault. Could you please upload it here? Since all filenames are encrypted, these are not sensitive data. But with that information, I can analyze the vault structure.