search

padelt / vzdump-plugin-b2

Encrypted off-site backup of Proxmox VE vzdump images for $5/month/TB
GNU General Public License v3.0
33 stars 14 forks source link

SysCallError(104, 'ECONNRESET') #2

Closed flamingice closed 8 years ago

flamingice commented 8 years ago

Hi, I get the following error when I try to backup, can you help me?

INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_23_51.vma.lzo.split.000.gpg: 27%|##6 | 1.07G/4.00G [01:29<10:00, 4.87MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_23_51.vma.lzo.split.000.gpg: 27%|##6 | 1.07G/4.00G [01:29<07:39, 6.36MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_23_51.vma.lzo.split.000.gpg: 27%|##6 | 1.07G/4.00G [01:29<04:04, 12.0MB/s]
INFO: ERROR: Unknown error: SysCallError(104, 'ECONNRESET')
INFO: Something went wrong uploading.
ERROR: Backup of VM 906 failed - command '/usr/local/bin/vzdump-plugin-b2/vzdump-plugin-upload-b2.sh backup-end snapshot 906' failed: exit code 10
INFO: Backup job finished with errors
flamingice commented 8 years ago 
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.001.gpg: 45%|####5 | 1.47G/3.27G [00:50<02:17, 13.1MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 91%|#########1| 3.66G/4.00G [00:50<00:04, 77.1MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.001.gpg: 45%|####5 | 1.48G/3.27G [00:50<01:01, 29.2MB/s]
INFO: ERROR: Unknown error: SysCallError(104, 'ECONNRESET')
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 92%|#########1| 3.66G/4.00G [00:50<00:06, 48.4MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 92%|#########1| 3.68G/4.00G [00:50<00:05, 55.9MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 92%|#########2| 3.68G/4.00G [00:51<00:05, 56.4MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 92%|#########2| 3.69G/4.00G [00:51<00:05, 58.1MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 93%|#########2| 3.70G/4.00G [00:51<00:04, 65.2MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 93%|#########2| 3.71G/4.00G [00:51<00:04, 65.2MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 93%|#########2| 3.71G/4.00G [00:51<00:04, 59.8MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 93%|#########2| 3.71G/4.00G [00:51<00:08, 32.2MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 93%|#########3| 3.72G/4.00G [00:51<00:07, 37.3MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 93%|#########3| 3.73G/4.00G [00:51<00:06, 39.0MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 93%|#########3| 3.73G/4.00G [00:52<00:06, 40.8MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 94%|#########3| 3.74G/4.00G [00:52<00:05, 48.8MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 94%|#########3| 3.75G/4.00G [00:52<00:04, 49.4MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 94%|#########4| 3.77G/4.00G [00:52<00:03, 60.2MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 94%|#########4| 3.77G/4.00G [00:52<00:04, 52.0MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 94%|#########4| 3.78G/4.00G [00:52<00:03, 57.8MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 94%|#########4| 3.78G/4.00G [00:52<00:12, 17.9MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 95%|#########4| 3.79G/4.00G [00:52<00:09, 23.4MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 95%|#########4| 3.79G/4.00G [00:53<00:08, 24.3MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 95%|#########4| 3.80G/4.00G [00:53<00:07, 27.4MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 95%|#########5| 3.80G/4.00G [00:53<00:07, 26.0MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 95%|#########5| 3.81G/4.00G [00:53<00:06, 29.8MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 95%|#########5| 3.81G/4.00G [00:53<00:05, 34.5MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 95%|#########5| 3.82G/4.00G [00:53<00:06, 27.6MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 96%|#########5| 3.82G/4.00G [00:54<00:05, 31.5MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 96%|#########5| 3.83G/4.00G [00:54<00:05, 31.6MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 96%|#########5| 3.83G/4.00G [00:54<00:05, 32.1MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 96%|#########6| 3.84G/4.00G [00:54<00:04, 38.8MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 96%|#########6| 3.85G/4.00G [00:54<00:04, 34.5MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 96%|#########6| 3.85G/4.00G [00:54<00:03, 41.5MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 96%|#########6| 3.86G/4.00G [00:54<00:05, 25.0MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 97%|#########6| 3.87G/4.00G [00:55<00:04, 31.2MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 97%|#########6| 3.87G/4.00G [00:55<00:07, 17.5MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 97%|#########6| 3.87G/4.00G [00:55<00:06, 20.5MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 97%|#########6| 3.88G/4.00G [00:55<00:04, 25.0MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 97%|#########7| 3.88G/4.00G [00:55<00:06, 19.9MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 97%|#########7| 3.88G/4.00G [00:56<00:08, 14.3MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 97%|#########7| 3.89G/4.00G [00:56<00:05, 18.3MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 97%|#########7| 3.90G/4.00G [00:56<00:04, 22.6MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 97%|#########7| 3.90G/4.00G [00:56<00:04, 21.4MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 98%|#########7| 3.90G/4.00G [00:56<00:04, 21.9MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 98%|#########7| 3.91G/4.00G [00:56<00:03, 27.0MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 98%|#########7| 3.92G/4.00G [00:57<00:03, 26.9MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 98%|#########7| 3.92G/4.00G [00:57<00:02, 27.6MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 98%|#########8| 3.92G/4.00G [00:57<00:03, 21.7MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 98%|#########8| 3.92G/4.00G [00:57<00:03, 22.5MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 98%|#########8| 3.93G/4.00G [00:57<00:02, 29.4MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 98%|#########8| 3.93G/4.00G [00:57<00:16, 3.89MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 98%|#########8| 3.94G/4.00G [00:57<00:11, 5.34MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 99%|#########8| 3.94G/4.00G [00:57<00:09, 6.05MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 99%|#########8| 3.94G/4.00G [00:58<00:07, 7.47MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 99%|#########8| 3.95G/4.00G [00:58<00:05, 9.32MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 99%|#########8| 3.95G/4.00G [00:58<00:04, 11.9MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 99%|#########8| 3.95G/4.00G [00:58<00:03, 14.2MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 99%|#########8| 3.96G/4.00G [00:58<00:03, 13.9MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 99%|#########8| 3.96G/4.00G [00:58<00:02, 16.5MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 99%|#########9| 3.97G/4.00G [00:59<00:01, 18.3MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 99%|#########9| 3.97G/4.00G [00:59<00:01, 19.4MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 99%|#########9| 3.97G/4.00G [00:59<00:01, 14.0MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 99%|#########9| 3.98G/4.00G [00:59<00:01, 13.7MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 100%|#########9| 3.98G/4.00G [01:00<00:01, 15.7MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 100%|#########9| 3.98G/4.00G [01:00<00:01, 7.92MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 100%|#########9| 3.99G/4.00G [01:01<00:01, 7.82MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 100%|#########9| 3.99G/4.00G [01:01<00:01, 7.03MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 100%|#########9| 3.99G/4.00G [01:02<00:01, 6.58MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 100%|#########9| 4.00G/4.00G [01:02<00:00, 7.70MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 100%|#########9| 4.00G/4.00G [01:03<00:00, 6.81MB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg: 100%|##########| 4.00G/4.00G [01:09<00:00, 57.3MB/s]
INFO: URL by file name: https://f001.backblazeb2.com/file/proxbackup/bb/storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg
INFO: URL by fileId: https://f001.backblazeb2.com/b2api/v1/b2_download_file_by_id?fileId=4_z6e8a2ac7a83b31da527e0f13_f200f0162e8cdc8dd_d20160925_m183847_c001_v0001021_t0008
INFO: {
INFO: "action": "upload",
INFO: "fileId": "4_z6e8a2ac7a83b31da527e0f13_f200f0162e8cdc8dd_d20160925_m183847_c001_v0001021_t0008",
INFO: "fileName": "bb/storage/vz/dump/vzdump-qemu-906-2016_09_25-20_34_22.vma.lzo.split.000.gpg",
INFO: "size": 4000000094,
INFO: "uploadTimestamp": 1474828727000
INFO: }
INFO: Something went wrong uploading.
ERROR: Backup of VM 906 failed - command '/usr/local/bin/vzdump-plugin-b2/vzdump-plugin-upload-b2.sh backup-end snapshot 906' failed: exit code 10
INFO: Backup job finished with errors
TASK ERROR: job errors
padelt commented 8 years ago

ECONNRESET indicates that the TCP connection broke down. I have no idea why though. May be anything between the b2 utility used for uploading and the Backblaze service.

I'd start debugging this by manually uploading the split file using the b2 tool. Maybe you can get a hint what is going wrong.

Good luck!

Philipp

flamingice commented 8 years ago

So the error has been reported to backblaze already (https://github.com/Backblaze/B2_Command_Line_Tool/issues/172). I just did a git pull in the B2_Command_Line_Tool folder and tried a backup afterwards - it did not fail this time! The only issue I had was a very slow (500kb/s down to ~70 kb/s) upload speed for one of the 2 split files, right after the first one was completed (log below).

---snip---
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_26-00_45_04.vma.lzo.split.001.gpg: 95%|#########4| 3.09G/3.26G [02:54<06:34, 421KB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_26-00_45_04.vma.lzo.split.001.gpg: 95%|#########4| 3.09G/3.26G [02:54<04:43, 584KB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_26-00_45_04.vma.lzo.split.000.gpg: 100%|##########| 4.00G/4.00G [02:54<00:00, 22.9MB/s]
INFO: URL by file name: https://f001.backblazeb2.com/file/proxbackup/bb/storage/vz/dump/vzdump-qemu-906-2016_09_26-00_45_04.vma.lzo.split.000.gpg
INFO: URL by fileId: https://f001.backblazeb2.com/b2api/v1/b2_download_file_by_id?fileId=4_z6e8a2ac7a83b31da527e0f13_f200f0162e8cdcce9_d20160925_m224951_c001_v0001025_t0015
INFO: {
INFO: "action": "upload",
INFO: "fileId": "4_z6e8a2ac7a83b31da527e0f13_f200f0162e8cdcce9_d20160925_m224951_c001_v0001025_t0015",
INFO: "fileName": "bb/storage/vz/dump/vzdump-qemu-906-2016_09_26-00_45_04.vma.lzo.split.000.gpg",
INFO: "size": 4000000094,
INFO: "uploadTimestamp": 1474843791000
INFO: }
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_26-00_45_04.vma.lzo.split.001.gpg: 95%|#########4| 3.09G/3.26G [02:55<05:22, 513KB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_26-00_45_04.vma.lzo.split.001.gpg: 95%|#########4| 3.09G/3.26G [02:55<05:37, 489KB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_26-00_45_04.vma.lzo.split.001.gpg: 95%|#########4| 3.09G/3.26G [02:56<05:59, 458KB/s]
INFO: /storage/vz/dump/vzdump-qemu-906-2016_09_26-00_45_04.vma.lzo.split.001.gpg: 95%|#########4| 3.09G/3.26G [02:56<06:38, 414KB/s]
---snip---
flamingice commented 8 years ago

Had another connreset error. I will close this issue and use a different script until b2 fixed their client.