search

outdoorbits / little-backup-box

This software turns a single-board computer into a versatile, pocket-sized backup solution. Especially for digital photography, this is the solution for backing up images and media files on mass storage devices when traveling or at events. Media content can be viewed and rated for the subsequent process.
http://littlebackupbox.com
GNU General Public License v3.0
504 stars 103 forks source link

Error with copy from SD mobile #129

Closed Asturbike closed 2 years ago

Asturbike commented 2 years ago

Hi,

I have a Xioami Redmi Note 9 Pro and when it comes to backup I have not been able to configure it. If I select copy from camera to internal I make the copy of the DCIM folder of the mobile but my photos are on the SD card.

I have tried to make a copy of the SD by selecting source - internal storage but it does not find the SD of the mobile.

Any configuration to copy the folders from the SD card of the mobile?

I have tried to select the path in the directory settings for backup but nothing.

Thank you very much for your help.

Translated with www.DeepL.com/Translator (free version)

outdoorbits commented 2 years ago

Hi, This is probably due to the (still) missing documentation, sorry. Most smartphones must be switched to PTP mode first. Has that already happened? In the event that this is not the problem, I have just expanded the logging. Please perform Settings -> update. Did that help?

Asturbike commented 2 years ago

Hi, Finally works fine too!! The problem, maybe, is that the SD have a lot of documents and directories (or the SD size.. or OrangePi Zero speed..) and the backup takes 5 minutes to start. If I wait 5 minutes I see the backup in course. Thanks.

I try to update and the screen is all white.. image

outdoorbits commented 2 years ago

From my Galaxy A72 it takes also a while to read the folders, but maybe 15, not 300 seconds! But of course, it might be your large sd-card. Is the backup-speed acceptable?

I just did a update (to test) without problems. If it does not start, you could try a reload... But for to update you also can run the install-script like you did in the installation-process.

Asturbike commented 2 years ago

I have 2 phones and the "problem" is the same, about 300 secs to start, but the backup-speed is normal. I updated with the script with the installation.

Thanks , your work is fantastic!!

If you need help to translations to spanish or any task about lbb, contact me!

outdoorbits commented 2 years ago

Thank you. I think, if you pull up your log level to 3 you would see hundreds of folders and that's why it takes such a long time.

outdoorbits commented 2 years ago

Hi, I just added a function to speed up a lot and save that minutes. Please update and have a look at https://github.com/outdoorbits/little-backup-box/wiki/04.-Setup

Asturbike commented 2 years ago

Hi, Today I have other problem, when I choose *DCIM, lbb work like yesterday, found the SD and when lbb is working the web crash and the directory is like: image

I have a lot of temporals and the backup crash.

When I choose RedmiNote9Pro:!/store_00020002/DCIM, to copy 600 photos the time estimate is 8 hours... image

outdoorbits commented 2 years ago

Hi, while testing yesterday I had a similar problem once but could never reproduce. I hope to find some time later...

outdoorbits commented 2 years ago

For a quick try, could you disable Log-sync-protocol in Settings?

Asturbike commented 2 years ago

the problem continue, a lot of tmpfiles and directories and the copy is slow, same cable and same phone. Tis backup yesterday 10 minutes, today...

image

outdoorbits commented 2 years ago

There is an update online now. For me this was working now. Does it solve the problem in your environment too?

Asturbike commented 2 years ago

Yes!! Time es normal, very fast. image

But now is the same case that yesterday, I wait 200 o 300 secs and the backup starts, but I am in no hurry!!

Thanks!!!

One question... Is it possible to have a extra button to copy internal storage (/media/internal/*) to external storage? I use for this project one orange pi zero with only one USB, and my idea is to cpy the photos to internal SD and later copy this photos to Nextcloud, this option works fine, but could copy other backup to the pendrive....

outdoorbits commented 2 years ago

Of course, good idea. The additional button was not a big deal and is available now. But in my tests the folders are not scanned anymore and backup from smartphone starts immediately. Could you please send another logfile of a backup having such a delay?

Asturbike commented 2 years ago

Now I tested the new button, Int to Ext, works very good!! Its very important for me thanks!!

Tomorrow I Will delete the phone directory and i Will test the backup and Will send the log

Asturbike commented 2 years ago

image

in the options I only have set to check the sd, but it also tries to copy from internal memory. When I activate the copy, it sends a copy completed email, then the usual wait and then it tries to copy from the SD.

log:

08:38:01 IP (online): 192.168.0.234 Backup complete. Do not unplug!

08:37:42 Backup complete. Do not unplug! Power down via web UI

08:37:41 Mail: Little Backup Box: Backup Backup complete.

Backup complete.

Type: camera to internal Camera: RedmiNote9Pro

Backup log:

---- try 1 ---- Skip existing file store_00010001/DCIM/.tmfs/.turing.dat Skip existing file store_00010001/DCIM/.tmfs/sk_v.dat Skip existing file store_00010001/DCIM/.tmsdual/860300598/sk_g.dat Skip existing file store_00010001/DCIM/Creative/IMG_20210627_211724.jpg Skip existing file store_00010001/DCIM/Creative/IMG_20210627_211816.jpg ................. ................. ................. xxxxxxxxxxxxxxxxxxxxxxxxx delete for the log..... xxxxxxxxxxxxxxxxxxxxxxxx

1 try/tries needed.

08:37:36 Backup status: 1 of 699 0% 00:34:54

08:37:33 Backup status: 0 of 699 %
comparing...

08:37:29

08:37:29

08:37:29 Folders to sync from camera 'RedmiNote9Pro':

08:34:01 IP (online): 192.168.0.234 Backup complete. Do not unplug!

08:33:42 Backup complete. Do not unplug! Power down via web UI

08:33:41 Mail: Little Backup Box: Backup Backup complete.

Backup complete.

Type: camera to internal Camera:

Backup log:

---- try 1 ---- For debugging messages, please use the --debug option. Debugging messages may help finding a solution to your problem. If you intend to send any error or debug messages to the gphoto developer mailing list gphoto-devel@lists.sourceforge.net, please run gphoto2 as follows:

env LANG=C gphoto2 --debug --debug-logfile=my-logfile.txt --filename %F/%f.%C --get-all-files --folder / --skip-existing --list-files

Please make sure there is sufficient quoting around the arguments.

1 try/tries needed.

08:33:35

08:33:35 Folders to sync from camera '':

08:33:34 Camera:

08:33:34 Camera o.k. Working... Ready

08:33:30 Camera o.k. Working... Ready Connect camera

08:33:26 Ready Connect camera Int. storage o.k. size: 113G

08:33:23 Int. storage o.k. size: 113G free: 97G RedmiNote9Pro

08:33:22 Destination: internal

08:33:22 Source: camera

08:33:12 Camera: RedmiNote9Pro

08:33:12 RedmiNote9Pro Camera o.k. Working... IP (online):

08:33:08 Camera o.k. Working... IP (online): 192.168.0.234

outdoorbits commented 2 years ago

Hi, could you please update and send the entry of your settings field?

Asturbike commented 2 years ago

What configuration do you need?

image

outdoorbits commented 2 years ago

Yes, this one, thank you. Same problem after update? If yes, could you send your log again?

Asturbike commented 2 years ago

I have 4 new photos but the lbb said backup complete...

09:52:54 Source: camera

09:52:54 Destination: internal

09:52:55 Int. storage o.k. size: 113G free: 97G IP (online):

09:52:59 Ready Connect camera Int. storage o.k. size: 113G

09:53:03 IP (online): 192.168.0.234 Ready Connect camera

09:53:03 Camera o.k. Working... IP (online): 192.168.0.234

09:53:07 RedmiNote9Pro Camera o.k. Working... IP (online):

09:53:07 Camera: RedmiNote9Pro

09:53:07 Folders to sync from camera 'RedmiNote9Pro':

09:53:07

09:53:12 Mail: Little Backup Box: Backup Backup complete.

Backup complete.

Type: camera to internal Camera: RedmiNote9Pro

Backup log:

---- try 1 ---- For debugging messages, please use the --debug option. Debugging messages may help finding a solution to your problem. If you intend to send any error or debug messages to the gphoto developer mailing list gphoto-devel@lists.sourceforge.net, please run gphoto2 as follows:

env LANG=C gphoto2 --debug --debug-logfile=my-logfile.txt --filename %F/%f.%C --get-all-files --folder /store_00020002/DCIM --skip-existing --list-files

Please make sure there is sufficient quoting around the arguments.

1 try/tries needed.

09:53:13 Backup complete. Do not unplug! Power down via web UI

09:54:01 IP (online): 192.168.0.234 Backup complete. Do not unplug!

outdoorbits commented 2 years ago

gphoto2 does not get a files count but gets the phones name. I had this when my phone didn't accept the connection. Was your phone unlocked? Did it ask to permit access?

Asturbike commented 2 years ago

yes my phone is unlocked and... i don´t know if permit access, if the setting is *DCIM the copy is ok

outdoorbits commented 2 years ago

Could you send the Log of *:DCIM please? I will add a few log-points later today and ask you again for logs...

Asturbike commented 2 years ago

the new photos with *DCIM setting are with permissions root:root

-rwxrwxrwx+ 1 www-data www-data 4378987 Jan 14 08:16 IMG_20220114_081620.jpg -rwxrwxrwx+ 1 www-data www-data 3783933 Jan 14 08:18 IMG_20220114_081824.jpg -rw-r--r--+ 1 root root 4555743 Jan 14 09:52 IMG_20220114_095212.jpg -rw-r--r--+ 1 root root 4004037 Jan 14 09:52 IMG_20220114_095214.jpg -rw-r--r--+ 1 root root 3262182 Jan 14 12:43 IMG_20220114_124337.jpg -rw-r--r--+ 1 root root 3506203 Jan 14 12:43 IMG_20220114_124345.jpg -rw-r--r--+ 1 root root 5619686 Jan 14 12:59 IMG_20220114_125900.jpg

log *DCIM (delete skipped photos) 14:26:52 Source: camera

14:26:52 Destination: internal

14:26:53 Int. storage o.k. size: 113G free: 97G IP (online):

14:26:57 Ready Connect camera Int. storage o.k. size: 113G

14:27:00 Camera o.k. Working... Ready Connect camera

14:27:04 RedmiNote9Pro Camera o.k. Working... Ready

14:27:04 Camera: RedmiNote9Pro

14:27:05 IP (online): 192.168.0.234 RedmiNote9Pro Camera o.k.

14:31:45 Folders to sync from camera 'RedmiNote9Pro':

14:31:45

14:31:45

14:31:50 Backup status: 0 of 704 %
comparing...

14:31:53 Backup status: 1 of 704 0% 00:35:09

14:32:02 IP (online): 192.168.0.234 Backup status: 1 of 704

14:32:04 Mail: Little Backup Box: Backup Backup complete.

Backup complete.

Type: camera to internal Camera: RedmiNote9Pro

Backup log:

---- try 1 ---- Skip existing file store_00010001/etc*** There is no file in folder '/store_00020001/DCIM'. There are 689 files in folder '/store_00020001/DCIM/Camera'.

1 IMG_20210927_201554.jpg rd 7363 KB 4640x3472 image/jpeg

etc...

1 try/tries needed.

14:32:05 Backup complete. Do not unplug! Power down via web UI

14:33:01 IP (online): 192.168.0.234 Backup complete. Do not unplug!

outdoorbits commented 2 years ago

Of course, the file-backup runs as root (sudo), the owner is o.k. Did you check the destination-folder for the files? Maybe they are already there? On camera-backup the script just gets the number of images at the camera but it can't compare with the target. So it tries to copy all the images to target but at target the filecount doesn't change, because the images have already been there. So the progress-information fails...

outdoorbits commented 2 years ago

... and there is an update with some more log-points around camera-backup. Could you try a backup RedmiNote9Pro:!/store_00020002/DCIM and send the logfile (loglevel 3)?

Asturbike commented 2 years ago

don´t found new photos...

... and there is an update with some more log-points around camera-backup. Could you try a backup RedmiNote9Pro:!/store_00020002/DCIM and send the logfile (loglevel 3)?

13:53:52 Source: camera

13:53:52 Destination: internal

13:53:52 umount_device: 'usb_1'? ''

13:53:52 umount_device: 'usb_2'? ''

13:53:53 Int. storage o.k. size: 113G free: 97G Backup complete.

13:53:57 Ready Connect camera Int. storage o.k. size: 113G

13:54:00 Camera o.k. Working... Ready Connect camera

13:54:03 IP (online): 192.168.0.234 Camera o.k. Working...

13:54:04 RedmiNote9Pro IP (online): 192.168.0.234 Camera o.k.

13:54:04 Camera: RedmiNote9Pro

13:54:04 Folders to sync from camera 'RedmiNote9Pro':

13:54:05

13:54:06 gphoto2 --list-files --folder "/store_00020002/DCIM": exitcode=1 For debugging messages, please use the --debug option. Debugging messages may help finding a solution to your problem. If you intend to send any error or debug messages to the gphoto developer mailing list gphoto-devel@lists.sourceforge.net, please run gphoto2 as follows:

env LANG=C gphoto2 --debug --debug-logfile=my-logfile.txt --list-files --folder /store_00020002/DCIM

Please make sure there is sufficient quoting around the arguments.

13:54:06 Files in folder '/store_00020002/DCIM': 0

13:54:06 Files to sync before backup: 0

13:54:06 Backup from camera: /store_00020002/DCIM

13:54:06 SYNC_RETURN_CODE: 1; SYNC_TIME: 0

13:54:07 umount_device: 'usb_1'? ''

13:54:07 umount_device: 'usb_2'? ''

13:54:10 Mail: Little Backup Box: Backup Backup complete.

Backup complete.

Type: camera to internal Camera: RedmiNote9Pro

Backup log:

---- try 1 ---- For debugging messages, please use the --debug option. Debugging messages may help finding a solution to your problem. If you intend to send any error or debug messages to the gphoto developer mailing list gphoto-devel@lists.sourceforge.net, please run gphoto2 as follows:

env LANG=C gphoto2 --debug --debug-logfile=my-logfile.txt --filename %F/%f.%C --get-all-files --folder /store_00020002/DCIM --skip-existing --list-files

Please make sure there is sufficient quoting around the arguments.

1 try/tries needed.

13:54:11 Backup complete. Do not unplug! Power down via web UI

13:55:07 IP (online): 192.168.0.234 Backup complete. Do not unplug!

outdoorbits commented 2 years ago

We are getting closer. At least we have an error message: gphoto2 --list-files --folder "/store_00020002/DCIM" causes an error. Could you please run a "*:DCIM" backup on the same device, with the same sd-card again and post the log? Alternatively you can also login via ssh and execute this: gphoto2 --list-files --folder | grep DCIM I hope, the paths differ to "/store_00020002/DCIM".

There is one difference between your last post and your last *:DCIM logfile In your last post. You configured "RedmiNote9Pro:!/store_00020002/DCIM" while before you had "RedmiNote9Pro:!/store_00020001/DCIM"

Maybe it is just that? What does the 00020001/DCIM and 00020002/DCIM mean? You could configure both (if you use 2 sd-cards in exchange - maybe the difference indicates the cards?): RedmiNote9Pro:!/store_00020001/DCIM;RedmiNote9Pro:!/store_00020002/DCIM should check both options.

Asturbike commented 2 years ago

Yes!! My error, Really is /media/internal/RedmiNote9Pro/store_00020001/DCIM/Camera/

Now works but process no finish

13:29:52 Source: camera

13:29:52 Destination: internal

13:29:52 umount_device: 'usb_1'? ''

13:29:52 umount_device: 'usb_2'? ''

13:29:53 Int. storage o.k. size: 113G free: 97G IP (online):

13:29:57 Ready Connect camera Int. storage o.k. size: 113G

13:30:01 IP (online): 192.168.0.234 Ready Connect camera

13:30:22 Camera o.k. Working... IP (online): 192.168.0.234

13:30:26 RedmiNote9Pro Camera o.k. Working... IP (online):

13:30:26 Camera o.k. Working... Camera o.k. Working...

13:30:26 Camera: RedmiNote9Pro

13:30:26 Folders to sync from camera 'RedmiNote9Pro':

13:30:26

13:30:27 gphoto2 --list-files --folder "/store_00020002/DCIM": exitcode=1 For debugging messages, please use the --debug option. Debugging messages may help finding a solution to your problem. If you intend to send any error or debug messages to the gphoto developer mailing list gphoto-devel@lists.sourceforge.net, please run gphoto2 as follows:

env LANG=C gphoto2 --debug --debug-logfile=my-logfile.txt --list-files --folder /store_00020002/DCIM

Please make sure there is sufficient quoting around the arguments.

13:30:27 Files in folder '/store_00020002/DCIM': 0

13:30:27 Files to sync before backup: 0

13:30:27 Backup from camera: /store_00020002/DCIM

13:30:28 SYNC_RETURN_CODE: 1; SYNC_TIME: 1

13:30:28 umount_device: 'usb_1'? ''

13:30:28 umount_device: 'usb_2'? ''

13:30:29 RedmiNote9Pro Backup status: 0 of 0 ?%

13:30:29 Camera: RedmiNote9Pro

13:30:29 Folders to sync from camera 'RedmiNote9Pro':

13:30:29

13:30:35 gphoto2 --list-files --folder "/store_00020001/DCIM": exitcode=0 There is no file in folder '/store_00020001/DCIM'. There are 706 files in folder '/store_00020001/DCIM/Camera'.

1 IMG_20210927_201554.jpg rd 7363 KB 4640x3472 image/jpeg

2 IMG_20210929_105736.jpg rd 4906 KB 4640x3472 image/jpeg

13:30:35 Files in folder '/store_00020001/DCIM': 706

13:30:35 Files to sync before backup: 706

13:30:36 Backup from camera: /store_00020001/DCIM

13:30:36 Backup status: 0 of 706 %
comparing...

13:30:39 Backup status: 4 of 706 0% 00:08:46

13:30:54 SYNC_RETURN_CODE: 0; SYNC_TIME: 19

13:30:55 umount_device: 'usb_1'? ''

13:30:55 umount_device: 'usb_2'? ''

outdoorbits commented 2 years ago

Hi, well, last post wasn't loglevel 3. right? But it looks good. Are you sure, the target folder was empty before? Could it be, the files have been already there? The script detects 706 files on source. For me it looks like, it checks the files and only 4 of them has been new. Did the logfile really end with the line _umount_device: 'usb2'? ''"?

outdoorbits commented 2 years ago

I'm very interested about every potential problem of lbb, so descriptions of trouble are important to me. It's the only way, to make it "bullet proof" one day. ;-) Can you still reproduce the problem? Thank you for your help on debugging!