search

rustic-rs / rustic

rustic - fast, encrypted, and deduplicated backups powered by Rust
https://rustic.cli.rs
Apache License 2.0
1.64k stars 60 forks source link

Unrepairable repository corruption when using flaky FUSE drive as repository #1164

Open intgr opened 3 weeks ago

intgr commented 3 weeks ago

This is a whole saga and not Rustic's fault.

All of this has been with stable Rustic version v0.7.0

I tried using GNOME's OneDrive integration (gvfs-daemon via FUSE) as my backup repository. Due to memory leaks, gvfsd-onedrive kept crashing (killed by OOM killer), resulting in Rustic reporting an I/O error in the middle of the backup. I retried lot of times and tried to cancel the backup manually before the system ran out of memory, and eventually completed the backup this way. (Some irrelevant details here: https://github.com/rustic-rs/rustic/issues/1161#issuecomment-2163692346)

But the resulting repository has some unfixable corruption. I would be even more impressed with rustic if were able to fix this mess. ๐Ÿ˜†

rustic check is now reporting lots of issues. I ran both rustic repair index and rustic repair snapshots a few times. They seemed to complete successfully, but this has not solved the corruption.

During index check there are warnings like:

[WARN] pack 0a9c4874 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.

And later from checking trees I get errors:

[ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 4c3eb6e0 is missing in index

I later switched from GVFS to using rclone to access OneDrive. With rclone, on the same repo, I'm seeing following errors and also panics, see comment below.

http: invalid Content-Length of "-4294967260"

Full output from `rustic check` ``` [INFO] using config /home/[...]/.config/rustic/marti-onedrive.toml [INFO] repository rclone:[...]:Rustic/[...]: password is correct. [INFO] using cache at /home/[...]/.cache/rustic/cb7a46d5c182130aef5d93db778cfc00a7bb6f7ae56012f66b7bee0c54bf1424 [00:00:00] checking Snapshot in cache... โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ 23.70 KiB/23.70 KiB 11.59 MiB/s (ETA 0s) [00:00:00] checking Index in cache... โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ 20.04 MiB/20.04 MiB 1.46 GiB/s (ETA 0s) [00:00:00] reading index... โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ 61/61 [00:00:00] listing packs... โ  [WARN] pack 022d8fbe not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 0a9c4874 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 10d9c666 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 136cae46 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 19ec19df not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 21bc573a not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 2ba9f91f not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 2cc02d93 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 2f0cdf05 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 3530d311 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 3951ae4e not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 3ddc1aad not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 420db463 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 4874f11b not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 46fed4d0 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 474c7c9e not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 4b4ff701 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 4dfecfdf not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 50eaef64 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 545a8614 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 55e955cf not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 56ce9c76 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 650e3362 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 6550b4d0 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 6b37d990 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 747b9d33 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 71643f37 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 75691078 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 850446d3 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 876d9b13 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 88e6777b not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 912dd04d not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 9a88fbd3 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack 9d52ee22 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack af32416b not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack b2624c6b not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack b65f12ea not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack b6de6d89 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack ba5f0442 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack bc07e832 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack c7722913 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack ca6c52ca not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack cd7318f8 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack c9767f0c not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack d015e6f1 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack e398c00c not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack e8742332 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack e8d0842c not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack ef6f5329 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [WARN] pack ef8d3a9e not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'. [00:00:08] listing packs... [00:00:00] cleaning up packs from cache... [00:00:02] checking packs in cache... โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ 47.12 MiB/47.12 MiB 22.32 MiB/s (ETA 0s) [00:00:00] reading snapshots... โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ 44/44 [00:00:00] checking trees... โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘ 17/44 [ERROR] file "home/[...]/aosp_d5503-ota-eng.clinton.zip" blob 72b66821 is missing in index [ERROR] file "home/[...]/aosp_d5503-ota-eng.clinton.zip" blob 4c3b7108 is missing in index [ERROR] file "home/[...]/aosp_d5503-ota-eng.clinton.zip" blob c26d59d0 is missing in index [ERROR] file "home/[...]/aosp_d5503-ota-eng.clinton.zip" blob b1c19b66 is missing in index [ERROR] file "home/[...]/aosp_d5503-ota-eng.clinton.zip" blob a6ed1174 is missing in index [ERROR] file "home/[...]/aosp_d5503-ota-eng.clinton.zip" blob 88cc57d4 is missing in index [ERROR] file "home/[...]/aosp_d5503-ota-eng.clinton.zip" blob 78c6055c is missing in index [ERROR] file "home/[...]/aosp_d5503-ota-eng.clinton.zip" blob be58285f is missing in index [ERROR] file "home/[...]/lineage-15.1-20190114-UNOFFICIAL-signed-amami.zip" blob 9efb5d7a is missing in index [ERROR] file "home/[...]/lineage-15.1-20190114-UNOFFICIAL-signed-amami.zip" blob f08caef2 is missing in index [ERROR] file "home/[...]/lineage-15.1-20190114-UNOFFICIAL-signed-amami.zip" blob ba1638c9 is missing in index [ERROR] file "home/[...]/lineage-15.1-20190114-UNOFFICIAL-signed-amami.zip" blob 36cb2bfa is missing in index [ERROR] file "home/[...]/lineage-15.1-20190114-UNOFFICIAL-signed-amami.zip" blob 28b66535 is missing in index [ERROR] file "home/[...]/lineage-15.1-20190114-UNOFFICIAL-signed-amami.zip" blob 188d037d is missing in index [ERROR] file "home/[...]/lineage-15.1-20190114-UNOFFICIAL-signed-amami.zip" blob ff1e4e12 is missing in index [ERROR] file "home/[...]/open_gapps-arm-8.1-mini-20190126.zip" blob e8202087 is missing in index [ERROR] file "home/[...]/open_gapps-arm-8.1-mini-20190126.zip" blob 264dc4f9 is missing in index [ERROR] file "home/[...]/open_gapps-arm-8.1-mini-20190126.zip" blob 510df1c3 is missing in index [ERROR] file "home/[...]/open_gapps-arm-8.1-mini-20190126.zip" blob 29b6e480 is missing in index [ERROR] file "home/[...]/patched.zip" blob 2602bcdf is missing in index [ERROR] file "home/[...]/patched.zip" blob e709ab28 is missing in index [ERROR] file "home/[...]/patched.zip" blob 10954fa3 is missing in index [ERROR] file "home/[...]/patched.zip" blob 7c57c086 is missing in index [ERROR] file "home/[...]/patched.zip" blob 3baa20ec is missing in index [ERROR] file "home/[...]/patched.zip" blob c85bcc59 is missing in index [ERROR] file "home/[...]/patched.zip" blob 7242f01f is missing in index [ERROR] file "home/[...]/patched.zip" blob 761c6fdd is missing in index [00:00:00] checking trees... โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘ 20/44 [ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 34bbcc60 is missing in index [ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 7592aa0c is missing in index [ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 0fefefe4 is missing in index [ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob c0d191d5 is missing in index [ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 5e5c671e is missing in index [ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob f209cd78 is missing in index [ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 657ae1d8 is missing in index [ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 49c8ae01 is missing in index [ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 507c8e13 is missing in index [ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 69aa35fa is missing in index [ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 08de151d is missing in index [ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 3d337be2 is missing in index [ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 2c5b07f2 is missing in index [ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 91eaab56 is missing in index [ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 62c5f1a1 is missing in index [ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob ab8709ca is missing in index [ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob f5e4d313 is missing in index [ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 261d3a60 is missing in index [ERROR] file "home/[...]/nAOSProm-6.0-b12.zip" blob 3167a61a is missing in index [ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob 4ec93d0b is missing in index [ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob 74853669 is missing in index [ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob 8b9941bc is missing in index [ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob 5905c174 is missing in index [ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob 65122353 is missing in index [ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob 15010372 is missing in index [ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob 96240ba4 is missing in index [ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob 5a45f750 is missing in index [ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob 86633c65 is missing in index [ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob aa16e46e is missing in index [ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob eb48beec is missing in index [ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob 193f5653 is missing in index [ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob 77bb1e66 is missing in index [ERROR] file "home/[...]/nAOSProm-7.1.1-b2.4.zip" blob c001682a is missing in index [ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 00a9edf0 is missing in index [ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 74d92352 is missing in index [ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 0b42f0b9 is missing in index [ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 4d7ed4b9 is missing in index [ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 319ee5f7 is missing in index [ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob e460645e is missing in index [ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob c3835f11 is missing in index [ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 5cd2a440 is missing in index [ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 5839e80b is missing in index [ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 5c3e564a is missing in index [ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 4a6d8a67 is missing in index [ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 24598d33 is missing in index [ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob fb108c24 is missing in index [ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob f2f2e15a is missing in index [ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob d8a1d357 is missing in index [ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 49a66195 is missing in index [ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 4f3558c5 is missing in index [ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 7173d21f is missing in index [ERROR] file "home/[...]/cm-11-20140531-UNOFFICIAL-hikari.zip" blob 4afe71a7 is missing in index [ERROR] file "home/[...]/loader.sin" blob 0de5e0c8 is missing in index [ERROR] file "home/[...]/system.new.dat.br" blob 9efb5d7a is missing in index [ERROR] file "home/[...]/system.new.dat.br" blob f08caef2 is missing in index [ERROR] file "home/[...]/system.new.dat.br" blob ba1638c9 is missing in index [ERROR] file "home/[...]/system.new.dat.br" blob 36cb2bfa is missing in index [ERROR] file "home/[...]/system.new.dat.br" blob 28b66535 is missing in index [ERROR] file "home/[...]/system.new.dat.br" blob 188d037d is missing in index [ERROR] file "home/[...]/system.new.dat.br" blob ff1e4e12 is missing in index [ERROR] file "home/[...]/system.new.dat.br" blob 9efb5d7a is missing in index [ERROR] file "home/[...]/system.new.dat.br" blob f08caef2 is missing in index [ERROR] file "home/[...]/system.new.dat.br" blob ba1638c9 is missing in index [ERROR] file "home/[...]/system.new.dat.br" blob 36cb2bfa is missing in index [ERROR] file "home/[...]/system.new.dat.br" blob 28b66535 is missing in index [ERROR] file "home/[...]/system.new.dat.br" blob 188d037d is missing in index [ERROR] file "home/[...]/system.new.dat.br" blob ff1e4e12 is missing in index [00:00:00] checking trees... โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘ 21/44 [ERROR] file "home/[...]/.supersu" blob 2a7c8f80 is missing in index [ERROR] file "home/[...]/loader.sin" blob 0de5e0c8 is missing in index [ERROR] file "home/[...]/partition-image.sin" blob 8a95556e is missing in index [ERROR] file "home/[...]/simlock.ta" blob 22fb01d5 is missing in index [ERROR] file "home/[...]/system.sin" blob 7f485271 is missing in index [ERROR] file "home/[...]/system.sin" blob aff78f42 is missing in index [ERROR] file "home/[...]/system.sin" blob 8975f647 is missing in index [ERROR] file "home/[...]/system.sin" blob 3a93473e is missing in index [ERROR] file "home/[...]/system.sin" blob cc327927 is missing in index [ERROR] file "home/[...]/system.sin" blob 7e264cc5 is missing in index [ERROR] file "home/[...]/system.sin" blob c692f6fd is missing in index [ERROR] file "home/[...]/system.sin" blob 8a7aeab4 is missing in index [ERROR] file "home/[...]/system.sin" blob a9a5cbaf is missing in index [ERROR] file "home/[...]/system.sin" blob 16b3f059 is missing in index [ERROR] file "home/[...]/system.sin" blob c45fbf2e is missing in index [ERROR] file "home/[...]/system.sin" blob 43e84ebc is missing in index [ERROR] file "home/[...]/system.sin" blob 3bfa72a6 is missing in index [ERROR] file "home/[...]/system.sin" blob a238ce69 is missing in index [ERROR] file "home/[...]/system.sin" blob e03355d2 is missing in index [ERROR] file "home/[...]/userdata.sin" blob f573ff0a is missing in index [ERROR] file "home/[...]/userdata.sin" blob e9b73e36 is missing in index [ERROR] file "home/[...]/userdata.sin" blob 20346769 is missing in index [ERROR] file "home/[...]/userdata.sin" blob e7c42c76 is missing in index [ERROR] file "home/[...]/loader.sin" blob 0de5e0c8 is missing in index [ERROR] file "home/[...]/partition-image_S1-SW-LIVE-DE72-PID1-0002-MBR.sin" blob 8a95556e is missing in index [ERROR] file "home/[...]/userdata_S1-SW-LIVE-DE72-PID1-0002-S1-PARTITION.sin" blob 20346769 is missing in index [00:00:00] checking trees... โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘ 28/44 [ERROR] file "home/[...]//CERT.RSA" blob 6617381d is missing in index [ERROR] file "home/[...]/CERT.SF" blob f514803a is missing in index [ERROR] file "home/[...]/MANIFEST.MF" blob 43ac727d is missing in index [00:00:00] checking trees... โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘ 29/44 [ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob c7c281bd is missing in index [ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 4c3eb6e0 is missing in index [ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 6c49e7cb is missing in index [ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob fafddba0 is missing in index [ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 046d1af2 is missing in index [ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob bc97df21 is missing in index [ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob e826908d is missing in index [ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 61aae48c is missing in index [ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 61f23dea is missing in index [ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob a9b76a30 is missing in index [ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 29664bd4 is missing in index [ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 4559e0cd is missing in index [ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 9dfa6f6c is missing in index [ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 2f48f15f is missing in index [ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob ba743a69 is missing in index [ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob e4bcd365 is missing in index [ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 7f5adadb is missing in index [ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 77101d97 is missing in index [ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 30753dbe is missing in index [ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob 5d78b5a6 is missing in index [ERROR] file "home/[...]/.git/objects/pack/pack-3bf046d811b499f0762bfe7930fa16da8bf5f70c.pack" blob f0800c21 is missing in index [00:00:00] checking trees... โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘ 30/44 [ERROR] file "home/[...]" blob 10a114a0 is missing in index [00:00:00] checking trees... โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ 44/44 ```
intgr commented 3 weeks ago

After switching from GVFS to rclone, I'm getting new errors about invalid Content-Length.

It's also weird that rustic repair index gives different results from different invocations. Every time I run it, it seems to "switch" between the two following behaviors...

[WARN] error reading pack 850446d3 (not processed): Failed reading binary representation of the pack header
[00:00:00] reading pack headers           โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘          1/50
[INFO] rclone output: 2024/06/13 18:03:48 http: invalid Content-Length of "-4294967292"
[...]
[00:00:16] reading pack headers           โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ         50/50

And at other times this makes repair index panic and abort. Running with RUST_BACKTRACE=1

[INFO] pack ef8d3a9e: size computed by index: 36, actual size: 0, will re-read header
[INFO] pack b65f12ea: size computed by index: 36, actual size: 0, will re-read header
[INFO] pack 50eaef64: size computed by index: 36, actual size: 0, will re-read header
[00:00:00] reading index...               โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ         62/62
[00:00:00] reading pack headers           โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘          0/50                                            
[INFO] rclone output: 2024/06/13 18:08:42 http: invalid Content-Length of "-4294967260"

The application panicked (crashed).
Message:  split_off out of bounds: 32 <= 0
Location: /build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/bytes-1.5.0/src/bytes.rs:363

  โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” BACKTRACE โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”
   1: __libc_start_main<unknown>
      at <unknown source file>:<unknown line>

Run with COLORBT_SHOW_HIDDEN=1 environment variable to disable frame filtering.
Run with RUST_BACKTRACE=full to include source snippets.
zsh: IOT instruction (core dumped)  RUST_BACKTRACE=1 rustic --use-profile=marti-onedrive repair index

When I re-build with debug profile, it fails with a different error quite early:

[INFO] using config /home/[...]/.config/rustic/marti-onedrive.toml
[INFO] repository rclone:[...]:Rustic/[...]: password is correct.
[INFO] using cache at /home/[...]/.cache/rustic/cb7a46d5c182130aef5d93db778cfc00a7bb6f7ae56012f66b7bee0c54bf1424
[00:00:07] listing packs...
[00:00:00] reading index...               โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ         61/61
[00:00:00] reading pack headers           โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘          0/50
The application panicked (crashed).
Message:  attempt to subtract with overflow
Location: /home/[...]/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustic_core-0.2.0/src/repofile/packfile.rs:273

  โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” BACKTRACE โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”
                                โ‹ฎ 8 frames hidden โ‹ฎ
   9: core::panicking::panic::h8ddd58dc57c2dc00
      at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/panicking.rs:145
  10: rustic_core::repofile::packfile::PackHeader::from_file::hff56f5fbde035331
      at /home/[...]/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustic_core-0.2.0/src/repofile/packfile.rs:273
  11: rustic_core::commands::repair::index::RepairIndexOptions::repair::hd355066ea134323b
      at /home/[...]/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustic_core-0.2.0/src/commands/repair/index.rs:132
  12: rustic_core::repository::Repository<P,S>::repair_index::h5e3f7c65ddc36b56
      at /home/[...]/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustic_core-0.2.0/src/repository.rs:1165
  13: rustic_rs::commands::repair::IndexSubCmd::inner_run::h691bfa9802d6bd96
      at /home/[...]/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustic-rs-0.7.0/src/commands/repair.rs:64
  14: <rustic_rs::commands::repair::IndexSubCmd as abscissa_core::runnable::Runnable>::run::hcd79e93179d8ac5c
      at /home/[...]/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustic-rs-0.7.0/src/commands/repair.rs:53
  15: rustic_rs::commands::repair::_DERIVE_Runnable_FOR_RepairSubCmd::<impl abscissa_core::runnable::Runnable for rustic_rs::commands::repair::RepairSubCmd>::run::hcf42d39c02b230c6
      at /home/[...]/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustic-rs-0.7.0/src/commands/repair.rs:18
  16: <rustic_rs::commands::repair::RepairCmd as abscissa_core::runnable::Runnable>::run::hf55ad7e4798d73f6
      at /home/[...]/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustic-rs-0.7.0/src/commands/repair.rs:47
  17: rustic_rs::commands::_DERIVE_Runnable_FOR_RusticCmd::<impl abscissa_core::runnable::Runnable for rustic_rs::commands::RusticCmd>::run::hc9fe3f27537c2212
      at /home/[...]/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustic-rs-0.7.0/src/commands.rs:66
  18: <rustic_rs::commands::EntryPoint as abscissa_core::runnable::Runnable>::run::h1e13c05e0b539332
      at /home/[...]/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustic-rs-0.7.0/src/commands.rs:162
  19: abscissa_core::application::Application::run::h7e1d4be225564626
      at /home/[...]/.cargo/registry/src/index.crates.io-6f17d22bba15001f/abscissa_core-0.7.0/src/application.rs:61
  20: abscissa_core::application::boot::h7426452f266f429c
      at /home/[...]/.cargo/registry/src/index.crates.io-6f17d22bba15001f/abscissa_core-0.7.0/src/application.rs:176
  21: rustic::main::h95a53ce26a54442e
      at /home/[...]/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustic-rs-0.7.0/src/bin/rustic.rs:28
  22: core::ops::function::FnOnce::call_once::h89fb5b7a2d8c3881
      at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/ops/function.rs:250
                                โ‹ฎ 15 frames hidden โ‹ฎ

Run with COLORBT_SHOW_HIDDEN=1 environment variable to disable frame filtering.
Run with RUST_BACKTRACE=full to include source snippets.