search

outdoorbits / little-backup-box

This software turns a single-board computer into a versatile, pocket-sized backup solution. Especially for digital photography, this is the solution for backing up images and media files on mass storage devices when traveling or at events. Media content can be viewed and rated for the subsequent process.
http://littlebackupbox.com
GNU General Public License v3.0
504 stars 103 forks source link

One SD Card won't backup #115

Closed ruebyi closed 2 years ago

ruebyi commented 3 years ago

I'm just on a trip and I'm using LBB on a pi4 to Backup 4 Cameras.

4 of 5 Cards are working properly, one not...

That's what the log gives to me:

2021/07/31 08:22:27 [5920] building file list 2021/07/31 08:22:27 [5920] rsync: chown "/media/storage/202107310002-27285/." failed: Operation not permitted (1) 2021/07/31 08:22:27 [5920] .d..tpog... ./ 2021/07/31 08:22:27 [5920] Number of files: 1 (dir: 1) 2021/07/31 08:22:27 [5920] Number of created files: 0 2021/07/31 08:22:27 [5920] Number of deleted files: 0 2021/07/31 08:22:27 [5920] Number of regular files transferred: 0 2021/07/31 08:22:27 [5920] Total file size: 0 bytes 2021/07/31 08:22:27 [5920] Total transferred file size: 0 bytes 2021/07/31 08:22:27 [5920] Literal data: 0 bytes 2021/07/31 08:22:27 [5920] Matched data: 0 bytes 2021/07/31 08:22:27 [5920] File list size: 0 2021/07/31 08:22:27 [5920] File list generation time: 0.001 seconds 2021/07/31 08:22:27 [5920] File list transfer time: 0.000 seconds 2021/07/31 08:22:27 [5920] Total bytes sent: 55 2021/07/31 08:22:27 [5920] Total bytes received: 110 2021/07/31 08:22:27 [5920] sent 55 bytes received 110 bytes 330.00 bytes/sec 2021/07/31 08:22:27 [5920] total size is 0 speedup is 0.00 2021/07/31 08:22:27 [5920] rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1207) [sender=3.1.3] Delete log

No ID File ist written.

The SD Card is from a DJI Mini 2 - DCIM Folder is in the main Directory, no Writeprotection etc. it's exFAT as all of my SD Cards.

The Same Card from my GoPro Backups perfectly.

outdoorbits commented 2 years ago

Thank you for the link to the powered hub. Maybe it's worth to test it for me. In your log of the failed remount the source device does not appear again at all. 30 seconds for cooling may be too short, but I don't know if Debian will automatically detect the device after that failure again anyway. Could your try to unplug the source device in case of that error and reconnect? I'm going to extend the time for cooling, do you think 60 seconds could be better?

outdoorbits commented 2 years ago

I just visited your website https://www.thelightdecides.com/ . Great images, I'm deeply impressed! The time for cooling I set to 60s now. Then I read on your website, you would like to know the estimated time to finish. Great idea. Done.

thelightdecides commented 2 years ago

Many thanks!!!

I will try again with the new version. I also have 2 other hubs that I will test, both have a USB-C input for the power supply, which I like much better than the micro USB port of the other hub. I won't have time this weekend, but I'll get back to you as soon as I can.

outdoorbits commented 2 years ago

Could you please tell me (and us) which hubs these are? The micro USB indeed was the reason I didn't order yet. So tests with these hubs also would be extremely interesting.

thelightdecides commented 2 years ago

ORICO 4-Port USB3.0 HUB (this has a short cable, better for traveling) https://www.amazon.de/gp/product/B08HVGCH8B/ref=ppx_yo_dt_b_asin_title_o00_s00?ie=UTF8&psc=1

UGREEN 4-Port USB 3.0 HUB https://www.amazon.de/gp/product/B08KXNDTPV/ref=ppx_yo_dt_b_asin_title_o00_s00?ie=UTF8&psc=1

but I didn't test them....

outdoorbits commented 2 years ago

Thank you. I just ordered the ORICO and hope this will my solution for travelling. This morning I put ~50GB images on a Sony XQD. As storage davice I used my SanDisk Extreme Portable SSD 1 TB. This is what I got:

In the last cases the XQD-reader seemed to fall into an error-condition and was not listed anymore. After disconnect and reconnect it appeared again but was lost after seconds. The display turned to black. While the XQD was connected directly to the pi, I had 4.7 V and less on the USB-ports. I think the problems described before, are more or less related to power-supply-problems. Maybe your cf-express-cardreader is better than mine but at the end, it could crash the same way.

outdoorbits commented 2 years ago

Just tested: The ORICO 4-Port USB3.0 HUB works well!

thelightdecides commented 2 years ago

That sounds good. I also did a few test runs, once it came to an error. The SSD and the card reader were both lost. Even after 60s they didn't show up again in the list, I unplugged them and plugged them back in, that didn't help either. Only a reboot of the Pi brought the two devices back on the list. But all other test runs worked fine, even with the 2TB SSD from Sandisk, which previously did not work directly on the USB port of the Pi. The new "remaining time" is very good. Also the whole web interface runs much more stable now in the new versions of LBB.

outdoorbits commented 2 years ago

This means, you did all your tests with devices directly connected to the pi, without a hub? Did you recognize a re-connect of devices? For now I'm very happy about this very small powered hub, it's moving into my backup-bag!

outdoorbits commented 2 years ago

Is it correct that all memory cards are working now and disconnections only occur when the problematic USB devices are connected directly to the rpi? Does everything work properly with powerd usb hubs? If so, I would like to close this long issue.

thelightdecides commented 2 years ago

Yes, I did all the test without a hub. Most of the time I use SD cards, and for SD cards and the Samsung T5 SDD, I don't need a hub. I only need the hub for my new Sandisk SSD and for the cf express cards. Often the cfexpress cards are copied without an error to the T5 SSD (both connected directly to the pi) but sometimes not. There was disconnections and reconnections of the cf express card reader (directly connectet to the pi). With both connected to the hub I got no error (during 7 test runs), only one when both devices get lost and no reconnection was possible. I just copied 13000 files from the T5 SSD to the Sandisk SSD (both connected to the hub), no error. I think it is working now.

Thank you very much for all the work!!!

ruebyi commented 2 years ago

So will you add your changes here, too? The fix is not working for my SD Cards, yet - I will try the active USB hub and another Cardreader

little-backup-box.log

outdoorbits commented 2 years ago

Dmitri seems to be a bit out of time actually and I think such a huge pull request, including fundamental changes, would be a burden to him. His idea was to put all my contributes in a development branch. But this wouldn't help you (and me). Until I get different information from him, I don't plan to push my contributes to dmpop.

outdoorbits commented 2 years ago

It is off-topic here, but there is a new function: Lots of cloud-storage-services can be used. Please have a look at the wiki. https://github.com/outdoorbits/little-backup-box https://github.com/outdoorbits/little-backup-box/wiki/05.-Operation